-- Logs begin at Tue 2022-08-30 15:37:49 UTC, end at Tue 2022-08-30 16:43:11 UTC. -- Aug 30 16:08:49.542789 dv-cinder-852208-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 16:08:49.550284 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 16:08:49 2022] *** Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: nodename: dv-cinder-852208-13-iscsi Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: machine: x86_64 Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: clock source: unix Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: pcre jit disabled Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: detected number of CPU cores: 4 Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: current working directory: / Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: detected binary path: /usr/bin/uwsgi-core Aug 30 16:08:49.553435 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: your processes number limit is 47680 Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: your memory page size is 4096 bytes Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: detected max file descriptor number: 2048 Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: lock engine: pthread robust mutexes Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: thunder lock: enabled Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 16:08:49.554106 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 16:08:49.593504 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: Python main interpreter initialized at 0x5598e15389c0 Aug 30 16:08:49.593504 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: python threads support enabled Aug 30 16:08:49.593504 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: your server socket listen backlog is limited to 100 connections Aug 30 16:08:49.593504 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: your mercy for graceful operations on workers is 90 seconds Aug 30 16:08:49.593899 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 16:08:49.593984 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: *** Operational MODE: preforking *** Aug 30 16:08:49.594193 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: *** uWSGI is running in multiple interpreter mode *** Aug 30 16:08:49.594193 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: spawned uWSGI master process (pid: 105579) Aug 30 16:08:49.594402 dv-cinder-852208-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 16:08:49.598421 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: spawned uWSGI worker 1 (pid: 105580, cores: 1) Aug 30 16:08:49.598421 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: spawned uWSGI worker 2 (pid: 105581, cores: 1) Aug 30 16:08:49.598421 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 16:08:50.256475 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:08:50.257074 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:08:51.355870 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:08:51.355870 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: from cryptography.utils import int_from_bytes Aug 30 16:08:51.356471 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:08:51.356471 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: from cryptography.utils import int_from_bytes Aug 30 16:08:51.357269 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:08:51.357269 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: from cryptography.utils import int_from_bytes Aug 30 16:08:51.357725 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:08:51.357725 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: from cryptography.utils import int_from_bytes Aug 30 16:08:53.848468 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:08:53.849133 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:08:53.849241 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:08:53.849597 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:08:53.849858 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:08:53.850251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.850578 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.850912 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.851238 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.851586 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.851903 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.852006 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:08:53.852387 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.852480 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:08:53.852588 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.852783 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:08:53.852880 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.853102 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.853199 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:08:53.853392 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:08:53.853486 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.853824 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.854058 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-13-iscsi {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.854205 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.854626 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.854966 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.855054 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.855338 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.855479 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.855703 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.855815 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856031 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856144 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856357 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856444 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856690 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856777 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.856955 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.857070 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.857275 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.857579 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.858875 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-13-iscsi {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.858875 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859131 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859308 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859437 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859575 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859709 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859839 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.859961 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.860092 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.860212 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.860390 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.860523 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.860647 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861035 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861035 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861259 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861405 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861561 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861684 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861814 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.861814 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862061 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-13-iscsi {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862195 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862326 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862455 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862576 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862707 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862835 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.862957 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863077 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863190 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863342 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863456 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863565 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863687 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863823 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.863954 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-13-iscsi {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864091 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864260 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864386 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864575 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864669 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864892 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.864976 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865281 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865380 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865608 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865692 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865913 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.865997 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866226 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866311 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866555 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866647 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866848 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.866938 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867157 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867272 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867493 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867580 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867747 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.867849 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868060 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868145 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868385 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868476 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868709 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.868807 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.869025 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.869117 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.869845 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.869940 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870029 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870209 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870354 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870521 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870679 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870773 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.870992 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871079 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871333 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871645 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871732 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.871957 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872050 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872267 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872359 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872518 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872619 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.872847 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873027 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873169 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873304 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873469 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873625 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873762 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.873897 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874078 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874231 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874407 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874558 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874694 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874828 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.874973 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875110 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875277 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875428 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875596 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875742 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.875924 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876079 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876250 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876403 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876578 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876735 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.876894 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877049 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877219 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877377 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877514 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877649 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877821 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.877973 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878118 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878254 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878442 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878586 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878783 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.878946 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879083 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879250 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879396 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879533 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879668 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879814 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.879975 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880126 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880262 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880398 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880575 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880725 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.880874 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881017 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881154 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881289 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881435 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881583 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881720 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881854 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.881999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882150 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882296 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882439 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882576 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882723 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.882865 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883002 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883150 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883308 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883492 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883651 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883790 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.883926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884138 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884284 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884420 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884563 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884711 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884848 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.884999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.885145 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.885290 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.885426 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.885584 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.885739 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.886513 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.886670 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.886834 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.886975 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887111 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887347 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887509 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887655 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887793 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.887937 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888074 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888218 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888355 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888497 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888634 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888778 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.888916 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889052 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889207 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889344 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889491 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889627 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889762 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.889907 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890072 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890217 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890526 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890704 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.890854 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891003 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891146 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891307 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891592 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891739 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.891884 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892022 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892177 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892315 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892450 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892599 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892742 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.892890 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893026 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893162 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893347 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893501 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893638 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893773 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.893942 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894088 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894237 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894375 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894522 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894659 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894804 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.894941 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.895158 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.895403 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.895542 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.895678 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.895813 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.895948 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.896096 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.896240 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.896376 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.896512 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.896658 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.896809 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.896952 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.897095 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.897232 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:08:53.897415 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.897559 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.897735 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.897887 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898065 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898211 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898379 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898523 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898678 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898815 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.898994 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899146 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899342 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899501 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899647 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899784 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.899983 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.900127 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.900302 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.900456 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.900659 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.900848 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901020 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901168 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901305 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901442 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901587 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901724 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.901912 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902054 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902233 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902393 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902543 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902691 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902832 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.902967 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903153 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903378 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903520 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903656 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903792 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.903927 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904110 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904264 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904415 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904553 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904728 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.904882 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905063 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905439 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905589 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905733 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.905867 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906017 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906155 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906324 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906469 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906637 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906794 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.906940 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907076 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907261 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907411 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907591 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907734 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.907910 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908056 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908220 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908370 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908533 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908686 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908832 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.908968 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909154 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909299 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909470 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909626 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909787 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.909931 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910101 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910245 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910416 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910569 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910720 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.910897 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911038 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911172 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911378 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911525 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911663 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911800 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.911935 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912070 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912245 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912399 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912560 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912715 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.912862 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913000 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913182 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913336 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913503 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913646 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913812 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.913957 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914103 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914247 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914413 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914558 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914726 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.914871 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915039 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915185 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915354 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915500 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915674 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.915826 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916008 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916198 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916423 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916562 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916698 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916843 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.916992 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917159 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917312 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917478 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917623 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917793 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.917945 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918124 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918279 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918424 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918561 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918736 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.918882 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919057 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919203 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919408 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919543 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919690 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919834 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.919997 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920141 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920306 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920459 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920610 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920758 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.920937 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921081 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921225 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921375 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921520 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921656 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921818 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.921962 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922133 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922285 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922461 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922607 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922776 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.922922 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923091 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923396 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923542 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923689 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923833 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.923968 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924137 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924292 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924452 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924607 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924768 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.924905 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925056 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925201 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925372 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925528 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925665 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925808 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.925951 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926088 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926233 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926544 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926714 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926860 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.926996 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927131 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927311 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927454 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927592 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927762 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.927909 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928053 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928196 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928360 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928510 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928660 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928803 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.928974 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929119 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929284 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929438 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929575 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929712 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.929885 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930031 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930234 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930388 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930546 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930701 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.930894 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.931081 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.931267 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.931422 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.931560 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.931703 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.932368 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.932512 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.932687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.932833 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933007 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933159 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933306 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933449 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933623 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933769 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.933941 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934093 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934254 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934397 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934611 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934749 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.934884 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935020 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935180 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935356 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935504 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935642 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935832 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.935978 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936148 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936299 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936471 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936617 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936781 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.936926 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937102 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937270 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937414 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937549 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937721 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.937873 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938194 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938356 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938500 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938680 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938833 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.938996 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939147 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939320 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939458 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939639 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939783 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.939954 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940108 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940253 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940388 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940576 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940718 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.940866 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941002 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941176 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941329 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941496 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941646 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941823 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.941976 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942135 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942279 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942453 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942597 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942748 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.942884 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943058 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943203 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943411 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943556 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943730 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.943884 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944027 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944163 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944335 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944489 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944650 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944794 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.944960 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945103 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945257 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945405 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945570 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945719 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945857 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.945991 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946169 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946321 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946459 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946593 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946770 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.946915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.947079 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.947320 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.947509 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948153 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948321 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948469 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948624 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948768 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.948910 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949051 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949193 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949341 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949509 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949663 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949818 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.949960 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950110 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950261 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950413 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950556 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950706 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950848 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.950990 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951132 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951344 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951492 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951634 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951788 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.951932 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952074 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952225 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952377 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952520 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952663 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952806 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.952957 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953108 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953393 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953535 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953687 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953840 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.953995 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954166 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954317 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954460 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954611 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954762 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.954907 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955057 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955200 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955396 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955550 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955703 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955847 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.955998 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956148 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956291 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956442 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956585 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956728 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.956877 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957032 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957176 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957327 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957488 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957631 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957773 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.957922 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958066 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958217 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958369 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958512 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958802 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.958952 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959117 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959342 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959493 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959655 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959805 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.959948 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960105 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960249 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960471 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960630 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960809 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.960963 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.961144 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.961407 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.961595 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.961745 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.961899 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962042 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962192 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962344 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962505 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962661 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962805 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.962955 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963153 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963331 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963488 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963632 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963789 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.963931 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964081 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964241 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964395 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964546 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964696 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964846 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.964998 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965181 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965372 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965521 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965665 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965818 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.965960 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966103 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966253 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966398 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966539 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966690 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966835 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.966986 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967141 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967313 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967461 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967604 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967757 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.967911 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968056 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968198 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968340 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968483 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968634 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968787 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.968931 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969073 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969215 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969357 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969510 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969666 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969810 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.969960 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970103 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970254 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970406 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970549 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970692 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970834 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.970983 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971126 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971303 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971513 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971660 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971803 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.971945 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972095 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972247 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972390 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972540 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972684 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972826 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.972979 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973130 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973281 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973434 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973576 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973720 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.973875 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974019 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974171 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974321 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974464 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974606 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974756 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.974900 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975050 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975193 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975402 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975546 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975706 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.975859 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976003 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976145 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976437 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976590 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976733 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.976876 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977019 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977171 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977323 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977467 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977609 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977759 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.977903 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978045 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978196 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978340 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978482 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978632 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978803 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.978947 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979110 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979286 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979438 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979581 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979730 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.979881 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980034 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980177 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980326 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980469 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980610 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980761 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.980906 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981060 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981217 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981562 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981716 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.981860 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982002 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982146 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982296 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982439 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982591 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982824 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.982976 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.983160 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.983431 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.983595 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.984855 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.985034 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.985183 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.985346 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.985504 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.985659 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.986066 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.986222 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.986873 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987023 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987184 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987419 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987568 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987712 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987855 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.987999 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988142 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988300 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988455 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988455 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988751 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988895 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.988895 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.989257 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.989403 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991008 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991173 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991173 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991535 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991691 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991691 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.991974 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992127 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992280 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992434 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992593 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992736 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.992879 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993022 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993588 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993781 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993940 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993940 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.993940 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.994908 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995061 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995314 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995314 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995621 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995765 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.995915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996078 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996221 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996362 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996502 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996650 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996793 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.996951 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997094 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997241 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997388 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997388 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997668 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997668 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.997958 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998107 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998249 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998388 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998528 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998678 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998819 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.998819 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999097 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999257 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999432 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999576 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999717 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:53.999866 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000008 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000008 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000289 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000432 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000573 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000713 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.000853 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001003 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001163 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001314 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001455 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001639 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001787 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.001927 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002077 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002220 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002368 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002509 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002657 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002816 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.002968 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003121 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003317 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003466 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003606 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003758 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.003908 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004054 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004201 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004201 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004466 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004615 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004757 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.004906 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005056 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005206 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005354 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005508 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005650 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005790 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.005929 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006076 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006226 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006367 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006513 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006660 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006809 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.006960 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007110 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007274 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007423 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007576 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007718 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.007888 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008043 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008207 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008361 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008503 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008642 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008801 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.008955 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009098 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009238 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009379 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009526 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009676 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.009818 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.010061 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.010752 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.010893 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011033 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011188 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011409 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011564 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011751 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.011905 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012046 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012195 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012336 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012476 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012617 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012757 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.012897 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013046 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013188 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013354 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013354 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013630 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013784 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.013932 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014073 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014214 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014353 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014499 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014656 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014808 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.014808 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015086 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015247 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015428 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015580 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015723 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.015876 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016019 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016160 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016301 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016441 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016582 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016732 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.016873 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017024 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017166 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017306 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017447 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017595 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017737 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.017878 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018026 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018026 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018302 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018444 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018592 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018592 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018877 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.018877 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019153 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019332 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019475 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019615 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019756 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.019898 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020051 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020051 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020319 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020460 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020624 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020766 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.020916 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021058 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021205 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021346 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021487 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021639 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021819 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.021967 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022115 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022263 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022418 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022579 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022729 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.022878 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023027 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023168 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023351 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023461 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023557 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023655 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023738 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023818 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023896 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.023990 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024072 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024151 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024232 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024405 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024485 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024564 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024564 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024720 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024799 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024891 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.024977 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025056 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025134 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025211 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025341 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025512 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025709 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025852 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.025993 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026135 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026308 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026466 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026610 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026751 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.026926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027086 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027439 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027593 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027742 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.027883 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028024 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028213 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028367 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028509 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028650 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028791 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.028942 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029093 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029243 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029386 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029533 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029708 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.029865 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030015 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030157 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030338 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030495 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030638 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030794 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.030955 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031105 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031286 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031438 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031579 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031730 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.031981 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032163 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032307 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032450 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032592 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032746 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.032901 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033062 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033203 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033344 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033485 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033777 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.033980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034128 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034270 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034424 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034569 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034709 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.034896 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035047 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035254 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035509 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035669 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035816 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.035978 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036124 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036265 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036415 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036557 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036700 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036842 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.036994 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037136 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037286 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037428 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037612 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037764 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.037914 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038066 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038249 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038400 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038565 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038721 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.038918 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.039170 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.039413 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.039558 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.039814 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.039973 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.040146 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.040306 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.040463 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.040637 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.040820 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041004 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041194 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041357 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041512 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041654 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041804 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.041994 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042151 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042295 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042436 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042634 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042844 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.042995 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.043240 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.043395 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.043634 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.043794 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.043961 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044119 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044270 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044412 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044585 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044734 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.044904 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045063 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045249 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045404 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045570 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045712 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.045860 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046010 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046163 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046306 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046469 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046627 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046781 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.046924 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047098 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047305 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047473 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047616 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047770 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.047920 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048062 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048204 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048353 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048502 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048652 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048802 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.048952 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049101 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049255 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049405 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049553 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049695 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.049900 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050057 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050228 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050391 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050533 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050680 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.050845 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051002 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051155 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051346 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051539 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051721 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.051869 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052049 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052207 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052350 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052491 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052684 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.052833 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053014 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053171 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053323 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053465 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053648 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053797 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.053982 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054142 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054291 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054434 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054575 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054716 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.054889 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055039 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055190 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055360 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055530 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055625 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.055855 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.056144 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.056254 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.056461 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.056568 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.056785 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.057384 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.057613 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.057702 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.057941 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058151 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058264 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058505 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058593 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058825 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.058912 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059154 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059516 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059626 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059825 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.059919 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060135 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060230 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060442 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060528 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060761 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.060847 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061074 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061169 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061385 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061472 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061698 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.061784 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062007 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062101 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062314 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062544 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062640 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062902 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.062997 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063240 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063330 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063558 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063657 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063870 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.063972 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064203 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064295 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064511 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064605 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064821 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.064965 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065130 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065233 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065437 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065523 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065743 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.065843 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066051 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066168 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066362 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066461 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066670 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066772 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.066987 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067117 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067312 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067402 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067623 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067712 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.067929 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068014 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068236 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068337 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068542 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068631 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068860 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.068948 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069203 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069289 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069517 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069695 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069851 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.069995 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070147 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070299 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070441 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070581 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070729 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.070870 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071018 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071168 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071349 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071493 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071634 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071774 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.071914 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.072076 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.072268 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.072532 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.073191 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.073411 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.073559 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.073775 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.073919 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074059 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074205 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074537 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074680 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074835 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.074983 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075124 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075296 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075456 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075600 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075740 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.075928 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076100 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076247 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076396 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076548 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076689 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076848 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.076988 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.077160 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.077317 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.077466 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.077710 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.077859 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078051 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078208 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078373 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078520 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078846 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.078993 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079143 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079313 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079459 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079610 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079762 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.079903 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080052 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080219 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080376 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080540 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080700 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080850 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.080991 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081140 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081280 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081450 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081608 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081759 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.081908 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082049 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082196 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082379 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082534 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082695 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082838 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.082979 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083119 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083285 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083449 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083601 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083743 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.083885 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084032 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084183 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084334 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084493 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084633 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084774 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.084975 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085124 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085296 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085445 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085621 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085772 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.085949 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086111 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086257 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086398 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086580 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086736 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.086879 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087028 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087171 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087349 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087527 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087690 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087832 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.087981 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088190 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088342 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088500 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088649 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088804 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.088946 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089165 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089313 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089476 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089625 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089784 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.089935 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090076 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090226 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090378 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090520 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090693 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090849 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.090991 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091130 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091311 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091458 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091611 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091762 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.091913 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092065 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092209 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092414 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092564 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092704 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092844 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.092984 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093124 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093277 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093421 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093569 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093723 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.093865 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094005 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094157 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094314 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094454 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094594 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094741 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.094891 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095032 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095172 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095353 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095499 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095640 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095789 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.095930 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096080 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096230 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096372 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096512 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096662 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096804 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.096945 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097085 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097225 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097400 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097564 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097713 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.097854 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098012 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098153 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098302 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098468 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098617 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098798 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.098947 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.099146 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.099538 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.099696 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.099838 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.099838 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100105 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100375 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100375 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100674 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100815 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.100955 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101095 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101234 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101382 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101538 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101688 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101830 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.101977 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102203 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102363 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102544 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102700 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102842 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.102982 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.103132 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.103308 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.103466 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.103608 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.104307 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.104452 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.104603 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.104755 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.104898 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105038 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105179 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105319 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105467 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105608 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105748 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.105889 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106030 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106179 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106321 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106462 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106613 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106753 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.106895 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107054 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107197 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107388 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107541 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107690 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107832 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.107982 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108124 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108265 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108416 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108558 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108707 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108849 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.108991 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109165 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109315 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109463 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109614 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109797 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.109946 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.110096 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.110248 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.110415 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.110572 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.110714 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111110 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111494 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111657 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111800 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.111941 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112151 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112302 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112488 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112693 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112840 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.112980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.113120 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.113261 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.113400 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.113549 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.113691 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:08:54.113832 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.114041 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.114370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.114701 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.115053 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.115399 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.115747 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.116080 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.116398 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.116711 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.117018 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:08:54.117263 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:08:54.266951 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO dbcounter [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Registered counter for database nova_api Aug 30 16:08:54.278247 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Registered counter for database nova_api Aug 30 16:08:54.291576 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.298844 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writer thread running {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.299237 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.305656 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.357594 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.context [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08a4461-15f4-4c54-a4a6-891b450b71c0(cell1) {{(pid=105581) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:08:54.361712 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.362184 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.363227 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.context [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08a4461-15f4-4c54-a4a6-891b450b71c0(cell1) {{(pid=105580) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:08:54.363824 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.364548 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.365003 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.367011 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_concurrency.lockutils [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105581) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.367103 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.367513 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.369016 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO dbcounter [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Registered counter for database nova_cell0 Aug 30 16:08:54.369109 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.369870 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.370319 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.372342 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.373230 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO dbcounter [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Registered counter for database nova_cell1 Aug 30 16:08:54.374301 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Registered counter for database nova_cell0 Aug 30 16:08:54.378304 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Registered counter for database nova_cell1 Aug 30 16:08:54.380359 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.383459 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.385869 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.390407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writer thread running {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.391072 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.391895 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.526811 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writer thread running {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.532039 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.536936 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO dbcounter [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Registered counter for database nova_cell0 Aug 30 16:08:54.540655 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Registered counter for database nova_cell0 Aug 30 16:08:54.545241 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.547351 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:08:54.550052 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writer thread running {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.552051 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:08:54.896142 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:08:54.898743 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: WARNING keystonemiddleware.auth_token [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:08:54.904486 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:08:54.908248 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: WARNING keystonemiddleware.auth_token [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:08:55.248503 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:08:55.254490 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:08:55.258984 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: WARNING keystonemiddleware.auth_token [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:08:55.259747 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598e15389c0 pid: 105580 (default app) Aug 30 16:08:55.262410 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:55.263626 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 30 16:08:55.264034 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue Aug 30 16:08:55 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:55.265597 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: WARNING keystonemiddleware.auth_token [None req-2c3862a0-e5d7-4a1f-a751-ca34c3947263 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:08:55.270878 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598e15389c0 pid: 105581 (default app) Aug 30 16:10:13.842745 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:13.844407 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Aug 30 16:10:13.844795 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:13.862377 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_api:SELECT=3 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.864103 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_cell1:SELECT=3 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.865130 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_cell0:SELECT=3 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.866734 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:14.769474 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-b36366e2-f6c1-47e0-ba48-4e637ecf5c38 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:14.802489 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-b36366e2-f6c1-47e0-ba48-4e637ecf5c38 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.950056 Aug 30 16:10:14.803239 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 30 16:10:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:17.216280 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:17.217276 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-8e8496e7-c0ff-4894-a11b-7408728b2ad7 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 30 16:10:17.217850 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:17.666864 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-748d5e67-b181-4410-a715-430bdfa261fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 256}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:17.713302 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-748d5e67-b181-4410-a715-430bdfa261fb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489239 Aug 30 16:10:17.714096 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:17.937923 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c6a4173e-fdcf-4e3b-ab6e-aef8d7672ac7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:17.944367 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:17.945171 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:17.946084 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell1:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:17.946789 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:18.008644 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c6a4173e-fdcf-4e3b-ab6e-aef8d7672ac7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286429 Aug 30 16:10:18.009243 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 30 16:10:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:20.399104 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-748d5e67-b181-4410-a715-430bdfa261fb admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:20.400076 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-748d5e67-b181-4410-a715-430bdfa261fb admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 30 16:10:20.400469 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:21.094245 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-a3c8503e-df6a-482f-9354-80a2de48d5a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:21.135081 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-a3c8503e-df6a-482f-9354-80a2de48d5a1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.728251 Aug 30 16:10:21.136463 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:21.148994 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-eb3ebb4d-1b2f-4bda-9d28-8f789411d768 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:21.185692 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-eb3ebb4d-1b2f-4bda-9d28-8f789411d768 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041035 Aug 30 16:10:21.186643 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 30 16:10:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:23.546655 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-a3c8503e-df6a-482f-9354-80a2de48d5a1 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:23.547634 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-a3c8503e-df6a-482f-9354-80a2de48d5a1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 30 16:10:23.548039 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:23.953055 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-a0d17383-3e18-4f5c-b777-566b12a12390 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:23.972972 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-a0d17383-3e18-4f5c-b777-566b12a12390 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418448 Aug 30 16:10:23.973514 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:23.986340 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-0f69146d-11dc-4a0f-b8a9-3be2a8165465 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:24.011317 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-0f69146d-11dc-4a0f-b8a9-3be2a8165465 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028810 Aug 30 16:10:24.012199 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 30 16:10:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:26.408801 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-a0d17383-3e18-4f5c-b777-566b12a12390 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:26.410363 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-a0d17383-3e18-4f5c-b777-566b12a12390 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Aug 30 16:10:26.410768 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:26.898680 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-663b1ec8-97c7-437d-abe5-f36e7a35210a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:26.920302 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-663b1ec8-97c7-437d-abe5-f36e7a35210a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502738 Aug 30 16:10:26.921158 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:26.934860 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-10875b82-f911-453d-b918-424f05c19a53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:26.959689 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-10875b82-f911-453d-b918-424f05c19a53 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029321 Aug 30 16:10:26.960258 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 30 16:10:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:29.379422 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-663b1ec8-97c7-437d-abe5-f36e7a35210a admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:29.380635 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-663b1ec8-97c7-437d-abe5-f36e7a35210a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Aug 30 16:10:29.381150 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:29.870162 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:29.894201 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506618 Aug 30 16:10:29.895262 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:29.907842 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-33601ba5-e7af-410b-810a-02927a651015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:29.933689 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-33601ba5-e7af-410b-810a-02927a651015 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029992 Aug 30 16:10:29.945887 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Tue Aug 30 16:10:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:32.321633 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.322939 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 30 16:10:32.323545 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:32.780971 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-70bde359-54d4-49d1-bf8a-5cb1527e734e admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.805270 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-70bde359-54d4-49d1-bf8a-5cb1527e734e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473447 Aug 30 16:10:32.805811 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:35.403942 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.404953 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-ed199882-1dd5-4be5-9001-44b568860259 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 16:10:35.405354 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:35.817784 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-4d699677-37a6-4d76-b62c-931d38d66b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1, "name": "m1.tiny"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:35.837152 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-4d699677-37a6-4d76-b62c-931d38d66b1c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425710 Aug 30 16:10:35.837634 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:35.851781 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f9dd1b71-4df3-4640-a85d-fda12c35cf45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:35.877836 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f9dd1b71-4df3-4640-a85d-fda12c35cf45 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029450 Aug 30 16:10:35.877836 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 30 16:10:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:38.231817 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-4d699677-37a6-4d76-b62c-931d38d66b1c admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:38.232836 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-4d699677-37a6-4d76-b62c-931d38d66b1c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 30 16:10:38.233239 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:38.639626 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-127cfa38-8b2e-423a-ba16-c323e6ad8d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:38.663197 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-127cfa38-8b2e-423a-ba16-c323e6ad8d56 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423379 Aug 30 16:10:38.663925 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:38.675753 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c5df8c38-90d6-4bbb-9b11-16c65a2c683c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:38.701280 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c5df8c38-90d6-4bbb-9b11-16c65a2c683c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029107 Aug 30 16:10:38.701847 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 30 16:10:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:41.097654 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-127cfa38-8b2e-423a-ba16-c323e6ad8d56 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:41.098662 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-127cfa38-8b2e-423a-ba16-c323e6ad8d56 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 30 16:10:41.099067 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:41.477918 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-3e1caa57-6785-42d7-be65-584e2c109639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:41.498706 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-3e1caa57-6785-42d7-be65-584e2c109639 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.392940 Aug 30 16:10:41.499316 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:41.513242 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-0a229dec-f371-4496-b7a8-34ac0edd6361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:41.544284 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-0a229dec-f371-4496-b7a8-34ac0edd6361 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035075 Aug 30 16:10:41.545182 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 30 16:10:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:43.970055 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-3e1caa57-6785-42d7-be65-584e2c109639 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.971408 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-3e1caa57-6785-42d7-be65-584e2c109639 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 30 16:10:43.971880 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:44.486472 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-8bdbc11d-abaf-445c-bb36-b7686b746220 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:44.494471 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:44.510967 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-8bdbc11d-abaf-445c-bb36-b7686b746220 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531147 Aug 30 16:10:44.518769 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:44.523934 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-0e7c6954-e97e-4e23-920c-510c0eae1e08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:44.548504 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-0e7c6954-e97e-4e23-920c-510c0eae1e08 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028356 Aug 30 16:10:44.549568 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 30 16:10:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:46.962710 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-8bdbc11d-abaf-445c-bb36-b7686b746220 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.963770 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-8bdbc11d-abaf-445c-bb36-b7686b746220 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 30 16:10:46.964442 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:47.444577 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "ram": 16384, "swap": 0}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:47.468788 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.495377 Aug 30 16:10:47.471266 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Tue Aug 30 16:10:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:47.482608 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-283d569d-2696-442f-869e-1ce4812a5c5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:47.520249 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-283d569d-2696-442f-869e-1ce4812a5c5f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041443 Aug 30 16:10:47.521689 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Tue Aug 30 16:10:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:06.195598 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:06.196533 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 30 16:11:06.196942 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:06.207351 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:06.597814 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-7442b024-dddc-42b6-b04e-7b16e414a889 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:06.617186 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-7442b024-dddc-42b6-b04e-7b16e414a889 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414237 Aug 30 16:11:06.617721 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 30 16:11:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:07.676782 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:07.677791 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-d67151a6-3ea8-4521-9361-6ac3cb912828 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 30 16:11:07.678187 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:08.205564 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-dbb42e52-9544-46ed-9b90-40dfdc7e70c6 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.211766 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.wsgi [None req-dbb42e52-9544-46ed-9b90-40dfdc7e70c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-dbb42e52-9544-46ed-9b90-40dfdc7e70c6 admin admin] Request method failure captured: Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept: application/json Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept-Encoding: gzip, deflate Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Connection: keep-alive Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Content-Length: 0 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Host: 10.222.0.57 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-System-Scope: None Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: User-Agent: python-novaclient Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Auth-Token: gAAAAABjDjab_E3GVbd9xGVfHg9Lr5u-4m158VC7dEnSxTUNNiTDwBF0VMcuU0U4T0QHXDw0wBPjWiApe5G7LKKhj964xHeUZJaKm-qCK4X7WepR1vb2_C-XNcnAOlX1KeUw5ot9NIXxnVt1XsgnmXt0dbK693kU6IuOL9QhGk4WdFri17YBhE8 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Id: None Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Name: None Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Identity-Status: Confirmed Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Is-Admin-Project: True Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Id: default Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Name: Default Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Name: admin Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Role: member,reader,admin Aug 30 16:11:08.214999 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Roles: member,reader,admin Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant: admin Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Name: admin Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User: admin Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Id: default Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Name: Default Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Name: admin Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: method: > Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: exception: Flavor 42 could not be found. Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: action_args: {'id': '42'} Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:08.216635 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.217554 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.218687 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-dbb42e52-9544-46ed-9b90-40dfdc7e70c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:08.219758 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-dbb42e52-9544-46ed-9b90-40dfdc7e70c6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401954 Aug 30 16:11:08.219758 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:08.226471 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-6e7c5014-e6d6-4d50-9244-d781180f1930 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.230818 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:08.250536 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-6e7c5014-e6d6-4d50-9244-d781180f1930 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027806 Aug 30 16:11:08.251093 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:08.261343 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-fc5c39dc-d7e8-49bd-9abf-d44cbb341073 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.284643 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-fc5c39dc-d7e8-49bd-9abf-d44cbb341073 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026824 Aug 30 16:11:08.285189 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:08.294852 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5926f7aa-68fd-4eff-a464-020737877b49 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.301090 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-5926f7aa-68fd-4eff-a464-020737877b49 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5926f7aa-68fd-4eff-a464-020737877b49 admin admin] Request method failure captured: Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept: application/json Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Connection: keep-alive Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Content-Length: 0 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Host: 10.222.0.57 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjDjab_E3GVbd9xGVfHg9Lr5u-4m158VC7dEnSxTUNNiTDwBF0VMcuU0U4T0QHXDw0wBPjWiApe5G7LKKhj964xHeUZJaKm-qCK4X7WepR1vb2_C-XNcnAOlX1KeUw5ot9NIXxnVt1XsgnmXt0dbK693kU6IuOL9QhGk4WdFri17YBhE8 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Role: member,reader,admin Aug 30 16:11:08.304370 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Roles: member,reader,admin Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant: admin Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User: admin Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Name: admin Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: method: > Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: exception: Flavor 42 could not be found. Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: action_args: {'id': '42'} Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:08.305915 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.306786 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.307943 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5926f7aa-68fd-4eff-a464-020737877b49 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:08.309147 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-5926f7aa-68fd-4eff-a464-020737877b49 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014541 Aug 30 16:11:08.309147 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:09.281671 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-fc5c39dc-d7e8-49bd-9abf-d44cbb341073 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.282683 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-fc5c39dc-d7e8-49bd-9abf-d44cbb341073 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 30 16:11:09.283074 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:09.848228 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-95d52101-a638-416a-a72b-1dadf860b5fc admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.854298 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-95d52101-a638-416a-a72b-1dadf860b5fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-95d52101-a638-416a-a72b-1dadf860b5fc admin admin] Request method failure captured: Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept: application/json Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Connection: keep-alive Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Content-Length: 0 Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Host: 10.222.0.57 Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjDjadfVhxaQYzrVRKnlLlqoq2S4nCiHeYKDwbEG0tj9JMhtZJkjklBPTv-m0khACP6ypIj7GDwh9hyybNCfZR92SHoWTzU_-LxvO9YryZ0j5yNOVmEWB5AGPsj6x_GkmgXX0oW9xRc9AbO0xx7bs1AdTCnOvUw-kQsVh-M3wh4tRjnEA Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Role: member,reader,admin Aug 30 16:11:09.855859 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Roles: member,reader,admin Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant: admin Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User: admin Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Name: admin Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: method: > Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: exception: Flavor 84 could not be found. Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: action_args: {'id': '84'} Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:09.857381 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:09.858337 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.859446 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-95d52101-a638-416a-a72b-1dadf860b5fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:09.860483 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-95d52101-a638-416a-a72b-1dadf860b5fc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.435506 Aug 30 16:11:09.860483 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:09.868072 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-465d6053-d021-4dd0-bab0-40d62a026768 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.884438 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-465d6053-d021-4dd0-bab0-40d62a026768 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020549 Aug 30 16:11:09.885022 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:09.896548 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-dd2b3a73-210b-457d-b55e-54a61ecd02a6 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.912985 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-dd2b3a73-210b-457d-b55e-54a61ecd02a6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021557 Aug 30 16:11:09.913550 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:09.923806 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-6c3d3901-9b79-4e1b-a9a2-599628cc4047 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.930028 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.wsgi [None req-6c3d3901-9b79-4e1b-a9a2-599628cc4047 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-6c3d3901-9b79-4e1b-a9a2-599628cc4047 admin admin] Request method failure captured: Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept: application/json Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept-Encoding: gzip, deflate Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Connection: keep-alive Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Content-Length: 0 Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Host: 10.222.0.57 Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-System-Scope: None Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: User-Agent: python-novaclient Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Auth-Token: gAAAAABjDjadfVhxaQYzrVRKnlLlqoq2S4nCiHeYKDwbEG0tj9JMhtZJkjklBPTv-m0khACP6ypIj7GDwh9hyybNCfZR92SHoWTzU_-LxvO9YryZ0j5yNOVmEWB5AGPsj6x_GkmgXX0oW9xRc9AbO0xx7bs1AdTCnOvUw-kQsVh-M3wh4tRjnEA Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Id: None Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Name: None Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Identity-Status: Confirmed Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Is-Admin-Project: True Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Id: default Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Name: Default Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Name: admin Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Role: member,reader,admin Aug 30 16:11:09.931598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Roles: member,reader,admin Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant: admin Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Name: admin Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User: admin Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Id: default Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Name: Default Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Name: admin Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: method: > Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: exception: Flavor 84 could not be found. Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: action_args: {'id': '84'} Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:09.933407 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:09.934629 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:09.936251 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-6c3d3901-9b79-4e1b-a9a2-599628cc4047 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:09.937667 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-6c3d3901-9b79-4e1b-a9a2-599628cc4047 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013242 Aug 30 16:11:09.937667 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 16:11:10.913703 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-dd2b3a73-210b-457d-b55e-54a61ecd02a6 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:10.914698 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-dd2b3a73-210b-457d-b55e-54a61ecd02a6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 30 16:11:10.915088 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:11.460174 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-83f710b0-e71d-4d41-b1a8-3d8cd7a7e262 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.465963 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.wsgi [None req-83f710b0-e71d-4d41-b1a8-3d8cd7a7e262 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-83f710b0-e71d-4d41-b1a8-3d8cd7a7e262 admin admin] Request method failure captured: Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept: application/json Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Accept-Encoding: gzip, deflate Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Connection: keep-alive Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Content-Length: 0 Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Host: 10.222.0.57 Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Openstack-System-Scope: None Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: User-Agent: python-novaclient Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Auth-Token: gAAAAABjDjae_orX6N5Zuc0FFBKwFzdH6u2pCUSC8P5qB_yIMC4YRCygHNlRD-MISh8YSmY04sNLJhQVmQUcV8If6r8dLox83v-ojAig0yCneWUOxX6VDBZ6akEmxbZjsP-hY7Arfso_MBki7U2p5n5zVT5tU_zp_vY8UQgtBMOYSi5C2BlBW_g Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Id: None Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Domain-Name: None Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Identity-Status: Confirmed Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Is-Admin-Project: True Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Id: default Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Domain-Name: Default Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Project-Name: admin Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Role: member,reader,admin Aug 30 16:11:11.467508 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Roles: member,reader,admin Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant: admin Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-Tenant-Name: admin Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User: admin Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Id: default Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Domain-Name: Default Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: X-User-Name: admin Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: method: > Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: exception: Flavor 451 could not be found. Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: action_args: {'id': '451'} Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:11.469318 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:11.470308 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.471529 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-83f710b0-e71d-4d41-b1a8-3d8cd7a7e262 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105581) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:11.472548 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-83f710b0-e71d-4d41-b1a8-3d8cd7a7e262 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.414088 Aug 30 16:11:11.472548 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:11.478502 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-db2c63e7-6e67-41ad-95ff-8153a2c7dde9 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.495397 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-db2c63e7-6e67-41ad-95ff-8153a2c7dde9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020310 Aug 30 16:11:11.496155 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:11.506760 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.522042 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019519 Aug 30 16:11:11.522596 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:11.532069 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-71362b29-0520-468a-ba25-af211bbdcd53 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.537839 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-71362b29-0520-468a-ba25-af211bbdcd53 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-71362b29-0520-468a-ba25-af211bbdcd53 admin admin] Request method failure captured: Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept: application/json Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Connection: keep-alive Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Content-Length: 0 Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Host: 10.222.0.57 Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.90 Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjDjae_orX6N5Zuc0FFBKwFzdH6u2pCUSC8P5qB_yIMC4YRCygHNlRD-MISh8YSmY04sNLJhQVmQUcV8If6r8dLox83v-ojAig0yCneWUOxX6VDBZ6akEmxbZjsP-hY7Arfso_MBki7U2p5n5zVT5tU_zp_vY8UQgtBMOYSi5C2BlBW_g Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Role: member,reader,admin Aug 30 16:11:11.539443 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Roles: member,reader,admin Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/82db1e68be334ddf84a8e69d95cda33e"}]}] Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant: admin Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 82db1e68be334ddf84a8e69d95cda33e Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User: admin Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Id: b24720c8535f4d608668a1e3b4a4419c Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: X-User-Name: admin Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: method: > Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: exception: Flavor 451 could not be found. Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: action_args: {'id': '451'} Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:11.541001 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:11.541926 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Aug 30 16:11:11.542980 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-71362b29-0520-468a-ba25-af211bbdcd53 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:11.544063 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-71362b29-0520-468a-ba25-af211bbdcd53 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012401 Aug 30 16:11:11.544063 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:11:12.514657 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:12.515702 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 30 16:11:12.516107 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:13.035426 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bb8d4f87-3ad0-4b7e-aff1-207010c08603 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:13.055341 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-bb8d4f87-3ad0-4b7e-aff1-207010c08603 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403385 Aug 30 16:11:13.055876 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 30 16:11:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:14.043263 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.044271 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 30 16:11:14.044674 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:14.579485 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-f2020a4d-1682-42c5-a57d-a1b95036ffcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:14.597737 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-f2020a4d-1682-42c5-a57d-a1b95036ffcd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.411919 Aug 30 16:11:14.598264 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 30 16:11:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:15.589631 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:15.590683 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 30 16:11:15.591197 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:16.134942 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c2163765-721b-47be-878f-6dc2edf4153e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:16.154319 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c2163765-721b-47be-878f-6dc2edf4153e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.425261 Aug 30 16:11:16.154812 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 30 16:11:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:17.131125 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:17.132205 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 30 16:11:17.132598 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:17.662012 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-f6d3bcb8-1368-41e4-a371-abf9c5ee9621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:17.681235 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-f6d3bcb8-1368-41e4-a371-abf9c5ee9621 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.412708 Aug 30 16:11:17.681795 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue Aug 30 16:11:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:18.668202 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:18.669232 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 30 16:11:18.669630 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:19.212106 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-0c247d08-fbda-4c40-9fc5-90d7c9456352 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.232234 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-0c247d08-fbda-4c40-9fc5-90d7c9456352 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.424869 Aug 30 16:11:19.232770 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:12.891560 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:12.892572 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-943fe962-b9b2-40c6-bf49-d1cffc8e86b7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 30 16:12:12.892967 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Tue Aug 30 16:12:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:12.903956 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:13.294262 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-9bf7fe96-605c-49fe-9325-6c859ee41973 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.315020 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-9bf7fe96-605c-49fe-9325-6c859ee41973 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415448 Aug 30 16:12:13.315533 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Tue Aug 30 16:12:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:13.337565 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG dbcounter [-] [105581] Writing DB stats nova_api:SELECT=14 {{(pid=105581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:13.341536 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f1a143b0-7970-4086-809a-c51311d9137b admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.349304 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f1a143b0-7970-4086-809a-c51311d9137b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013270 Aug 30 16:12:13.349831 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:13.361700 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-3a887563-6d1d-4420-93f0-f9adfe1b4bd3 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.369737 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-3a887563-6d1d-4420-93f0-f9adfe1b4bd3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011639 Aug 30 16:12:13.370265 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:13.382118 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.389974 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011958 Aug 30 16:12:13.390494 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:13.402504 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-dc90f0a3-5a7d-4021-9f8c-14804ab6c555 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.410032 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-dc90f0a3-5a7d-4021-9f8c-14804ab6c555 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011072 Aug 30 16:12:13.410553 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:07.355735 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.356738 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 30 16:15:07.357128 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:07.498855 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=6 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:07.658934 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.662559 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.663029 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.663512 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.664243 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.664686 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.665099 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.698138 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-0d74c140-4146-4703-8a3f-72bc2074ca82 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.200652 Aug 30 16:15:07.698688 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:15:08.536032 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:08.537116 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 30 16:15:08.537517 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:08.730612 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:08.735190 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.735691 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.736397 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.737448 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.737894 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.738316 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.758348 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-93060fec-baff-4aca-8bff-4f9c41965b8b admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079361 Aug 30 16:15:08.758910 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:15:19.994071 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:19.995079 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 30 16:15:19.995621 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:20.143061 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=4 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:20.143823 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell1:SELECT=4 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:20.144448 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=8 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:20.192691 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.196069 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.196537 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.196958 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.197654 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.198093 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.198505 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.225262 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-5f895539-cd6f-4fbd-90a4-d4c53c236e10 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086477 Aug 30 16:15:20.225798 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:21.059037 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: DEBUG nova.api.openstack.wsgi [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] Calling method '>' {{(pid=105581) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.060680 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: INFO nova.api.openstack.requestlog [None req-f0dbf66f-0508-4615-985a-b3f1208f9bdf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Aug 30 16:15:21.061076 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: [pid: 105581|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:21.288288 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.291678 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.292154 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.292630 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.293346 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.293795 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.294214 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.315993 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-e172f6c1-d37c-4c74-bf45-c77f0ec02968 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079773 Aug 30 16:15:21.316554 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:16:19.017547 dv-cinder-852208-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 16:16:19.018332 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: Tue Aug 30 16:16:19 2022 - graceful shutdown triggered... Aug 30 16:16:19.018771 dv-cinder-852208-13-iscsi devstack@n-api.service[105580]: Gracefully killing worker 1 (pid: 105580)... Aug 30 16:16:19.019129 dv-cinder-852208-13-iscsi devstack@n-api.service[105581]: Gracefully killing worker 2 (pid: 105581)... Aug 30 16:16:20.017957 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: worker 1 buried after 1 seconds Aug 30 16:16:20.018189 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: worker 2 buried after 1 seconds Aug 30 16:16:20.018189 dv-cinder-852208-13-iscsi devstack@n-api.service[105579]: goodbye to uWSGI. Aug 30 16:16:20.019605 dv-cinder-852208-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 16:16:20.020150 dv-cinder-852208-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 16:16:20.023018 dv-cinder-852208-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 16:16:20.036649 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 16:16:20 2022] *** Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: nodename: dv-cinder-852208-13-iscsi Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: machine: x86_64 Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: clock source: unix Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: pcre jit disabled Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: detected number of CPU cores: 4 Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: current working directory: / Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: detected binary path: /usr/bin/uwsgi-core Aug 30 16:16:20.039351 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: your processes number limit is 47680 Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: your memory page size is 4096 bytes Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: detected max file descriptor number: 2048 Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: lock engine: pthread robust mutexes Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: thunder lock: enabled Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 16:16:20.040658 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 16:16:20.079806 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: Python main interpreter initialized at 0x556afcb569c0 Aug 30 16:16:20.079806 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: python threads support enabled Aug 30 16:16:20.079806 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: your server socket listen backlog is limited to 100 connections Aug 30 16:16:20.079806 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: your mercy for graceful operations on workers is 90 seconds Aug 30 16:16:20.080216 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 16:16:20.080216 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: *** Operational MODE: preforking *** Aug 30 16:16:20.080454 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: *** uWSGI is running in multiple interpreter mode *** Aug 30 16:16:20.080454 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: spawned uWSGI master process (pid: 120570) Aug 30 16:16:20.080698 dv-cinder-852208-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 16:16:20.084357 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: spawned uWSGI worker 1 (pid: 120588, cores: 1) Aug 30 16:16:20.084357 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: spawned uWSGI worker 2 (pid: 120589, cores: 1) Aug 30 16:16:20.084357 dv-cinder-852208-13-iscsi devstack@n-api.service[120570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 16:16:20.740118 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:16:20.747562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:16:21.897966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:16:21.897966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Aug 30 16:16:21.898631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:16:21.898631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Aug 30 16:16:21.914724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:16:21.914724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: from cryptography.utils import int_from_bytes Aug 30 16:16:21.915451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:16:21.915451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: from cryptography.utils import int_from_bytes Aug 30 16:16:24.321571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:16:24.322217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:16:24.322382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:16:24.322748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:16:24.323006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:16:24.323547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.323885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.324218 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.324541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.325040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.325357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.325684 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.326008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.326340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.326604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.326922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.327861 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-13-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.328131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.328441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.328750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.329073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.329378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.329704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.330002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.330512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.330962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.331507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.332026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.332378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.332698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.333012 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.333350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.333657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.333986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.334294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.334736 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-13-iscsi {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.335022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.335382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.335710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.336129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.336447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.336782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.337091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.337415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.337736 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.338079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.338395 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.338717 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.339039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.339538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.339865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.340171 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.340492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.340803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.341109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.341363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.341671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.341994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.342492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.343385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.343679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.343932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.344266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.344588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.344900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.345210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.345516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.345824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.346134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.346455 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.346749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.347061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.347405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.347651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:16:24.348248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.348417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:16:24.348543 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.348543 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.348799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:16:24.348950 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349121 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:16:24.349248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:16:24.349424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349527 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349603 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.349915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350495 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.350888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351557 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351756 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.351865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.352139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.352299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.352933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.353459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.353573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.353661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.353872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-13-iscsi {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.354859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355520 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355816 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.355952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.356987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357301 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.357899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.358946 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359869 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.359954 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-13-iscsi {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360037 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360037 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.360957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361492 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361625 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.361929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362821 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.362926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.363875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364179 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.364997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.365954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.366897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.367073 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.367155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.368045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.368181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369337 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369724 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.369804 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.369882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.369960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.370123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.370271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.370413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.370578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370653 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.370723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.370869 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.371014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.371185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.371377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.371540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.371673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.371855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.372000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.372167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.372417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.372677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.372948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.373065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.373578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.373794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.373955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.374164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.374355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.374500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.374605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.374818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.374922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.375139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.375263 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.376209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.376339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.376426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.376500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.376577 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.376660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.376740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.376812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.376895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.376974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.377052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.377142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.377402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.377516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.377719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.377827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.378036 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.378130 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.378442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.378545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.378658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.378831 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.378990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.379137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.379310 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.379470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.379627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.379762 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.379894 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.380026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.380188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.380373 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.380507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.380612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.380825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.380926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.381139 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.381233 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.381454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.381554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.381767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.381865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.382078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.382178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.382391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.382489 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.382706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.382798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.383018 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.383112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.383366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.383472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.383683 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.383776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.384006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.384107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.384322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.384423 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.384677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.384793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.384975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.385072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.385253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.385355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.385563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.385650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.385872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.385980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.386177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.386265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.386486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.386580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.386793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.386886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.387103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.387203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.387420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.387507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.387734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.387835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.388065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.388242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.388388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.388520 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.388675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.388805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.388990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.389160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.389307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.389449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.390103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.390240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.390426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.390550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.390751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.390961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.391106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.391264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.391413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.391559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.391702 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.391830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.391991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.392124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.392304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.392427 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.392611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.392730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.392919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.393054 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.393234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.393334 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:16:24.393543 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.393643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.393858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394477 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.394797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395192 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395536 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.395905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396065 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.396851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.397818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398744 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.398949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.399065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.399363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.399552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.399721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.399866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.400883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401410 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.401967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.402067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.402208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.402336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.402534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.402843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403869 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.403997 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.404224 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.404313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.404601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.404718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.404870 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.405006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.406770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.407056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.411852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412166 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412862 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.412951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413803 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.413974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.414907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415001 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.415967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.416102 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.416198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.416198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417050 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417905 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.417989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.418911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419544 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.419996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.420980 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.421944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.422098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.422268 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.422366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.422654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.422769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.423890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424218 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424531 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424841 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.424937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.425910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.426139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.426369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.426575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.426744 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.426985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.427070 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.427326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.427483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.427664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.427810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.428798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.429018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.429203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.429203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.429630 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.429878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430331 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.430934 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.431882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432164 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.432966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.433912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434355 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.434938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435594 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.435919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.436068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.436209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.436481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.436672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.436672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.437264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.437424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.437573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.437723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.437875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438025 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.438860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439683 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.439849 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440083 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440521 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.440966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441561 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.441992 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.442935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.443987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444717 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.444877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445045 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445803 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.445945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.446086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.446227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.446382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.446682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.446875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.447386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.447560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.447707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.447707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.448707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.448872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.449909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450297 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450597 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.450899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.451806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.452004 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.452678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.452837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453367 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.453847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.454982 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.455920 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.456068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.456224 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.456373 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.456829 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.457015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.457304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.457638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.457802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.457961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.458947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459772 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.459958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460231 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.460990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461167 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461430 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.461991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462724 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.462898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.463860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.464030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.464177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.464496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.464812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.465119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.465251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.465468 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.465694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.465789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466056 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466375 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.466775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.467008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.467191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.467386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.467792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.468480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.468649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.468649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.468964 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.469919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.470966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.471123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.471288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.471455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.471687 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.471846 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472298 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.472933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473744 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.473906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474373 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.474972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.475968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476125 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.476960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.477196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.477359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.477518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.477775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.477936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.478092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.478242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.478390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.478731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.478904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479517 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.479981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.480988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.481961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.482257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.482414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.482573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.482731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.482889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.483968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484280 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484438 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.484900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.485979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486762 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.486911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.487069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.487364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.487522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.487670 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.487848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488728 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.488884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489056 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489216 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.489837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490324 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.490785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491383 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491542 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.491849 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492756 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.492914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.493918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494544 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.494864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.495854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.496975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.497123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.497270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.497532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.497704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.497855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.498010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.498258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.498688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.498853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499689 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.499851 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.500942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.501976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502430 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.502978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.503133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.503369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.503525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.503734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.503895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.504843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.505919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506230 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.506999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.507162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.507347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.507524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.507759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.507914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.508941 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509418 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.509866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.510949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.511116 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.511383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.511541 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.511699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.511858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512014 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.512955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513414 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.513937 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.514182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.515714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.515879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516355 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.516972 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517412 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.517978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.518134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.518134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.518418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.518668 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.518846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519050 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519212 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519397 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.519990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.520918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521224 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521400 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.521644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.522252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.523354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.523519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.523669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.523865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524333 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.524867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525159 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.525929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.526931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.527852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.528273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.528273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.528566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.528823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.528998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.529918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.530284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.530948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.531111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.531289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.531453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.531643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.531888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.532962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533418 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.533933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.534860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535415 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.535874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.536945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.537995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.538246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.538444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.538602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.538760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.539867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540035 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.540970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.541803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.542804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543768 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.543930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.544281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.544281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.544572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.544753 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.544911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545062 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.545851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546615 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.546921 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.547157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.547368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.547542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.547780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.547945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.548190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.549061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.549247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.549471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.549638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.550088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.550433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.550599 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.550790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.551017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.551175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.551386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.551601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.551921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.552974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.553133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.553422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.553588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.553832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554230 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.554961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.555118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.555315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.555722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.555897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.556190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.556550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.556724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.557031 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.557203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.557475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.557717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.557882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.558063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.558297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.558488 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.558742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.558909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.559067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.559354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.559522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.559673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.559821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560438 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.560999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.561226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.561498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.561714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.561881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562209 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.562954 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.563104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.563328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.563524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.563685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.563881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.564038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.564365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.564553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.565180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.565349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.565507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.565658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.565932 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.566121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.566521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.566942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.567938 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.568094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.568245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.568508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.568681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.569955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.570152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.570312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.570499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.570656 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.570836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.571943 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.572094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.573883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.574875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.575032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.575201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.575391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.575552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.575801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.576029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.576187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.576409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.576736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.577644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.577644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.577954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.578778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.578778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.579215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.579447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.579709 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.579868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.580995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.581792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582418 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.582869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.583966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.584949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.585106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.585264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.585414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.585623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.585876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.586033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.586249 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.586618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.586886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.587257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.587420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.587570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.587740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.587899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.588049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.588218 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.588398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.588557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.588768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.589145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.589404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.589781 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.589949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.590241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.590403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.590781 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.590942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.591329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.591519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.591929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.592108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.592647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.593816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.594384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.594638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.594934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.595102 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.595329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.595518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.595683 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.595990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.596194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.596359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.596615 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.596915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.597429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.597429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.597742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.597899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.598175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.598491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.598728 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:16:24.598994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.599659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.600107 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.600450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.600789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.601125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.601460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.601801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.602129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.602463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.602791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.603122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.603474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.603809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.604180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.604654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.604985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.605308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.605645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.605972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.606313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.606642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.606974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.607568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.607855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.608480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.608833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610008 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610008 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610008 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.610955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.611319 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.611648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.611973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.612298 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.612624 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.612946 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.613274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.613598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.613923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.614246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.614568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.614889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.615210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.615631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.615953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.616284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.616645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.616991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.617510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.617891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.618048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.618285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.618607 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.618959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.619419 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.619752 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.620120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.620421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.621132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.626991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.628652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.628652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.628652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.628652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.630984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.631711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.632291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.632660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.633000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.633336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.633668 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.634004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.634351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.634685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.635010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.635370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.635704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.636029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.636355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.636679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.637003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.637329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.637651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.638101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.638382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.638595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.638917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.639391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.640253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.641040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.644978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.644978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.645348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.645511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.646743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.646743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.646743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.646743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.648913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.649524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.649714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.649886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.650204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.650587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.650921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.651301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.651598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.651944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.652618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.652981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.653328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.653666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.654003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.654364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.654690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.655067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.655929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.656259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.656589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.656908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.657228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.657557 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.657879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.658203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.658534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.658861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.659199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.659951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.660126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.660424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.660904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.661341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.661664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.662155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.662561 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.662981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.663356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.663681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:16:24.663937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:16:24.667695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Registered counter for database nova_api Aug 30 16:16:24.689097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.696046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.728339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO dbcounter [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Registered counter for database nova_api Aug 30 16:16:24.748915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_db.sqlalchemy.engines [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.753620 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.context [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08a4461-15f4-4c54-a4a6-891b450b71c0(cell1) {{(pid=120588) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:16:24.756214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writer thread running {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.757686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:24.758238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.759817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.760553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:24.761008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.763011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.765648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Registered counter for database nova_cell0 Aug 30 16:16:24.769769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Registered counter for database nova_cell1 Aug 30 16:16:24.777076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.779420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.784547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.787075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.814119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.context [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e08a4461-15f4-4c54-a4a6-891b450b71c0(cell1) {{(pid=120589) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:16:24.818105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:24.818591 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.820233 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.820978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:24.821427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.823448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.825530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO dbcounter [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Registered counter for database nova_cell0 Aug 30 16:16:24.830228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO dbcounter [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Registered counter for database nova_cell1 Aug 30 16:16:24.838448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_db.sqlalchemy.engines [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.841648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_db.sqlalchemy.engines [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.846077 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writer thread running {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.849224 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writer thread running {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.935179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO dbcounter [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Registered counter for database nova_cell0 Aug 30 16:16:24.942376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:24.946938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:24.995886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO dbcounter [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Registered counter for database nova_cell0 Aug 30 16:16:25.003665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_db.sqlalchemy.engines [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:16:25.009143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writer thread running {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:16:25.269527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:16:25.276894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:16:25.332518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: WARNING keystonemiddleware.auth_token [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:16:25.339880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: WARNING keystonemiddleware.auth_token [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:16:25.622990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:16:25.629948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-16f355d2-d314-4bd4-ba6e-37f38771a434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:16:25.635335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556afcb569c0 pid: 120588 (default app) Aug 30 16:16:25.686749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: WARNING keystonemiddleware.auth_token [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:16:25.692796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: WARNING keystonemiddleware.auth_token [None req-e5923801-9d88-4528-9e46-78cc6f03e07c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:16:25.698117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556afcb569c0 pid: 120589 (default app) Aug 30 16:17:03.109781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:03.111452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:03.113270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:03.114905 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:04.377160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cf5ba0a-8299-4ea7-bc1a-a367be629dd3 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Action: 'create', calling method: .version_select at 0x7f1267d23e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2087971649"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:06.453199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cf5ba0a-8299-4ea7-bc1a-a367be629dd3 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.358131 Aug 30 16:17:06.454523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Tue Aug 30 16:17:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3364 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 16:17:06.896700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7ffe9637-961d-4691-96d7-642de6deb4ac tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267d889d0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:06.929760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:06.930972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:06.932416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:06.933703 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:07.215953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7ffe9637-961d-4691-96d7-642de6deb4ac tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 200 len: 345 microversion: 2.1 time: 0.739820 Aug 30 16:17:07.216704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:17:06 2022] GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 345 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:08.232544 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-870d7e98-cde3-430c-ab03-09614c804b09 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267baaca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:08.395413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-870d7e98-cde3-430c-ab03-09614c804b09 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 200 len: 346 microversion: 2.1 time: 0.168521 Aug 30 16:17:08.396374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:17:08 2022] GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:08.410359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6df0c0dd-6d6d-46ed-9a34-631063485749 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Action: 'create', calling method: .version_select at 0x7f1267bdac10>, body: {"snapshot": {"volume_id": "cb85083e-28cb-4cd9-87e2-aada02bbbd4c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1787724900"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:08.923432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6df0c0dd-6d6d-46ed-9a34-631063485749 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.517893 Aug 30 16:17:08.924005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 2/4] 10.222.0.57 () {60 vars in 1162 bytes} [Tue Aug 30 16:17:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:08.936423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9d9a743-73b6-40fd-bb9f-46b15f30d537 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bbf3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:09.078228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9d9a743-73b6-40fd-bb9f-46b15f30d537 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.146916 Aug 30 16:17:09.079430 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:08 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:09.091125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9f0a2e1d-2e02-4352-a131-c577deb98386 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b9f8b0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:09.186751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9f0a2e1d-2e02-4352-a131-c577deb98386 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.099826 Aug 30 16:17:09.187973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 30 16:17:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:09.200247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-989161ad-cdb2-4e57-aecd-fa03d395bbef tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bbfb80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:09.263251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-989161ad-cdb2-4e57-aecd-fa03d395bbef tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.068085 Aug 30 16:17:09.265019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:09 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:10.278456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8b032dbb-e75b-4720-b961-50afa49a77b1 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b9fc10>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:10.331564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8b032dbb-e75b-4720-b961-50afa49a77b1 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.057592 Aug 30 16:17:10.332621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:10 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:11.349152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e8ff11d-97c5-4ed1-a710-7f624292accb tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267baaca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:11.424208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e8ff11d-97c5-4ed1-a710-7f624292accb tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.083356 Aug 30 16:17:11.434055 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:11 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:12.441045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0e9d6ff9-0d91-4f08-99fb-6c4f25f2d495 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bb8940>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:12.513324 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0e9d6ff9-0d91-4f08-99fb-6c4f25f2d495 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.076287 Aug 30 16:17:12.514081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:12 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:13.526637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-344c806a-8bdd-48a3-b5b3-155d47a6a201 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bbfc10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:13.595035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-344c806a-8bdd-48a3-b5b3-155d47a6a201 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.072742 Aug 30 16:17:13.595756 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:13 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:14.608359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-89d68ff2-6f61-4551-9fd7-6712ca847356 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bb83a0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:14.686878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-89d68ff2-6f61-4551-9fd7-6712ca847356 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.082717 Aug 30 16:17:14.688564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:14 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:15.709109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7414ebad-1231-47a1-be36-cad9a196eca5 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267bbf430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:15.782481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7414ebad-1231-47a1-be36-cad9a196eca5 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.083525 Aug 30 16:17:15.783458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:15 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:16.469210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d89280c2-b40a-4883-ad81-8451feda0d87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: .version_select at 0x7f1267b9fa60>, body: {"keypair": {"name": "tempest-keypair-217951726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt+qnC4ypycqAjegH3sT3Qlib729Lxg7+ptXAdATcJOS4YbrPUvRxWFTQAy1ywwYVk3Ua76Haq4qQmpOhSusTfw8N3+LP059EM6RKwHaKJ9ijQXzhpfOoICLLs5ZKwFnw=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:16.690074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d89280c2-b40a-4883-ad81-8451feda0d87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for project d07b587d6ac148b0a7751c851260b3bc. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:16.714875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d89280c2-b40a-4883-ad81-8451feda0d87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for user c3dc3a92c6424cdbb3a2d3c1baaa95e3 and project d07b587d6ac148b0a7751c851260b3bc. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:16.810283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc49c400-38e4-4abd-8766-e7b61201d3de tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b491f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:16.832768 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d89280c2-b40a-4883-ad81-8451feda0d87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.680372 Aug 30 16:17:16.842907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 7/14] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 30 16:17:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:17:16.887452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc49c400-38e4-4abd-8766-e7b61201d3de tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.095392 Aug 30 16:17:16.888510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:16 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:17.909498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-205255a7-0fab-4324-a7fb-3dabe03f7ce8 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b10940>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:18.036341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-205255a7-0fab-4324-a7fb-3dabe03f7ce8 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.139771 Aug 30 16:17:18.038053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:17 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:19.051021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2b2037b8-030c-4a87-8557-8edb98df6adf tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b3a8b0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:19.179100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2b2037b8-030c-4a87-8557-8edb98df6adf tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.132521 Aug 30 16:17:19.180053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:19 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:19.675719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-709135181", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "networks": [{"uuid": "22a19da3-b161-4355-a7d7-5506012b3fee"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:19.894863 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] validate_networks() for [('22a19da3-b161-4355-a7d7-5506012b3fee', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:20.194461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7941f615-abdf-43d9-a0a1-4df6323eb0e4 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b3af70>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:20.317058 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7941f615-abdf-43d9-a0a1-4df6323eb0e4 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 288 microversion: 2.1 time: 0.128293 Aug 30 16:17:20.317731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:20 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:20.329072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4d552405-9453-40a7-a254-d4d5d319ddc7 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b3ac10>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:20.522361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4d552405-9453-40a7-a254-d4d5d319ddc7 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 202 len: 0 microversion: 2.1 time: 0.197394 Aug 30 16:17:20.522931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 11/19] 10.222.0.57 () {58 vars in 1254 bytes} [Tue Aug 30 16:17:20 2022] DELETE /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:17:20.532118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c33a7280-3920-45db-82a4-2d64d53dd5e2 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b3a4c0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:20.617617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c33a7280-3920-45db-82a4-2d64d53dd5e2 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 200 len: 287 microversion: 2.1 time: 0.090308 Aug 30 16:17:20.622394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 12/20] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:20 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:21.631403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-03b6fd79-525f-4fac-b153-5ca47fe05331 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267b10f70>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:21.729326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-03b6fd79-525f-4fac-b153-5ca47fe05331 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] HTTP exception thrown: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-03b6fd79-525f-4fac-b153-5ca47fe05331 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Request method failure captured: Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c HTTP/1.1 Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjf_36Q8tEW1XNHcxxerjZs55M2VftcDQpp73YlmiNmTN4JcCUy_IBY8iO3l4fIwvr_NraJhiQl4vPkYzdSm2K3dYKSRrOHp0wG_ZKqNQWmis9eOC1t3vUKvMon9hlOTclrGYAbtt-Do64IuWobfFVoTzuz2zvHOgmfkC3tSGs0lkuQ Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:21.734366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}] Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 73e7e33675ac4547b43305072412c709 Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'c46ebc0a-6474-43f1-b44e-03f2a11ab77c'} Aug 30 16:17:21.735583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. (HTTP 404) (Request-ID: req-5fa21d77-d6bd-442f-ab89-7ab0b6fdaca0) Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.736276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:21.737169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 16:17:21.738682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. Aug 30 16:17:21.740426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:21.742362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-03b6fd79-525f-4fac-b153-5ca47fe05331 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Returning 404 to user: Snapshot c46ebc0a-6474-43f1-b44e-03f2a11ab77c could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:21.743508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-03b6fd79-525f-4fac-b153-5ca47fe05331 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c" status: 404 len: 111 microversion: 2.1 time: 0.116478 Aug 30 16:17:21.747972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 13/21] 10.222.0.57 () {58 vars in 1251 bytes} [Tue Aug 30 16:17:21 2022] GET /compute/v2.1/os-snapshots/c46ebc0a-6474-43f1-b44e-03f2a11ab77c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:21.759984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-430e526f-5d3f-4f5f-a3eb-4b4b161f2e20 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267aa7790>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:21.964632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-430e526f-5d3f-4f5f-a3eb-4b4b161f2e20 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 202 len: 0 microversion: 2.1 time: 0.214834 Aug 30 16:17:21.965451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 14/22] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:17:21 2022] DELETE /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:17:21.973352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2b6f1461-ee75-4703-9500-5250e9773a67 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267aa7ee0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:22.156213 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-2b6f1461-ee75-4703-9500-5250e9773a67 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] HTTP exception thrown: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2b6f1461-ee75-4703-9500-5250e9773a67 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Request method failure captured: Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c HTTP/1.1 Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjf_36Q8tEW1XNHcxxerjZs55M2VftcDQpp73YlmiNmTN4JcCUy_IBY8iO3l4fIwvr_NraJhiQl4vPkYzdSm2K3dYKSRrOHp0wG_ZKqNQWmis9eOC1t3vUKvMon9hlOTclrGYAbtt-Do64IuWobfFVoTzuz2zvHOgmfkC3tSGs0lkuQ Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:22.159627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}] Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 73e7e33675ac4547b43305072412c709 Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'cb85083e-28cb-4cd9-87e2-aada02bbbd4c'} Aug 30 16:17:22.160692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. (HTTP 404) (Request-ID: req-fc7d7e67-16a9-4ac8-8f1c-c424fcbf75bd) Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.161361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:22.163785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:17:22.164694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2b6f1461-ee75-4703-9500-5250e9773a67 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Returning 404 to user: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2b6f1461-ee75-4703-9500-5250e9773a67 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 404 len: 109 microversion: 2.1 time: 0.191979 Aug 30 16:17:22.165745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 15/23] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:17:21 2022] GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:17:22.176251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bdd276d5-bc03-487f-924c-972b7bd9ccb6 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f1267aa75e0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:22.467861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-bdd276d5-bc03-487f-924c-972b7bd9ccb6 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] HTTP exception thrown: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bdd276d5-bc03-487f-924c-972b7bd9ccb6 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Request method failure captured: Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c HTTP/1.1 Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjf_36Q8tEW1XNHcxxerjZs55M2VftcDQpp73YlmiNmTN4JcCUy_IBY8iO3l4fIwvr_NraJhiQl4vPkYzdSm2K3dYKSRrOHp0wG_ZKqNQWmis9eOC1t3vUKvMon9hlOTclrGYAbtt-Do64IuWobfFVoTzuz2zvHOgmfkC3tSGs0lkuQ Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:22.470713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}] Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 73e7e33675ac4547b43305072412c709 Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'cb85083e-28cb-4cd9-87e2-aada02bbbd4c'} Aug 30 16:17:22.472034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. (HTTP 404) (Request-ID: req-2f4fd287-acd5-46f3-a42a-b2750ab72eec) Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.472801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:22.473992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:17:22.475160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bdd276d5-bc03-487f-924c-972b7bd9ccb6 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Returning 404 to user: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bdd276d5-bc03-487f-924c-972b7bd9ccb6 tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 404 len: 109 microversion: 2.1 time: 0.300910 Aug 30 16:17:22.476774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 16/24] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:17:22 2022] DELETE /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 109 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:22.493609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-550d5b3a-55fc-405e-a6d5-fc7c1f95292d tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Calling method '.version_select at 0x7f12685310d0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:22.565368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-550d5b3a-55fc-405e-a6d5-fc7c1f95292d tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] HTTP exception thrown: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-550d5b3a-55fc-405e-a6d5-fc7c1f95292d tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Request method failure captured: Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c HTTP/1.1 Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjf_36Q8tEW1XNHcxxerjZs55M2VftcDQpp73YlmiNmTN4JcCUy_IBY8iO3l4fIwvr_NraJhiQl4vPkYzdSm2K3dYKSRrOHp0wG_ZKqNQWmis9eOC1t3vUKvMon9hlOTclrGYAbtt-Do64IuWobfFVoTzuz2zvHOgmfkC3tSGs0lkuQ Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:22.569093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f871f9e81cc4408b579b65fc7537f3f"}]}] Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 8f871f9e81cc4408b579b65fc7537f3f Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-588326446 Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 73e7e33675ac4547b43305072412c709 Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-588326446-project Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'cb85083e-28cb-4cd9-87e2-aada02bbbd4c'} Aug 30 16:17:22.572905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. (HTTP 404) (Request-ID: req-385222e5-5350-48ce-9afe-3cc10c4d411e) Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.573644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:22.574559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:17:22.575605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. Aug 30 16:17:22.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:22.582257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-550d5b3a-55fc-405e-a6d5-fc7c1f95292d tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] Returning 404 to user: Volume cb85083e-28cb-4cd9-87e2-aada02bbbd4c could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:22.583685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-550d5b3a-55fc-405e-a6d5-fc7c1f95292d tempest-VolumesSnapshotsTestJSON-588326446 tempest-VolumesSnapshotsTestJSON-588326446-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c" status: 404 len: 109 microversion: 2.1 time: 0.106227 Aug 30 16:17:22.584917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 17/25] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:17:22 2022] GET /compute/v2.1/os-volumes/cb85083e-28cb-4cd9-87e2-aada02bbbd4c => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:17:22.784426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:22.785954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:22.786311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:22.789304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:22.789750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:22.831275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:22.831776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:22.833383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:22.835100 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:22.837035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:22.837546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:22.956449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Getting quotas for project 6c148946e0fe4eadacb3cfcade050e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:22.977734 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Getting quotas for user ca6d51cbceff489bae4222ff8888ac16 and project 6c148946e0fe4eadacb3cfcade050e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:23.000419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:23.004389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:23.193353 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f944b4ef-e306-4706-9d77-510b006615c8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.230534 Aug 30 16:17:23.198134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 9/26] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:17:23.210619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-064997db-1998-4446-a674-3f670eac5a29 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:23.211785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-064997db-1998-4446-a674-3f670eac5a29 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:23.299727 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-781072916", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "263eb0c3-89d1-4ff2-8ff6-6433b63ba805"}], "security_groups": [{"name": "tempest-securitygroup--1412685871"}], "key_name": "tempest-keypair-217951726", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:23.432603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-064997db-1998-4446-a674-3f670eac5a29 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:23.475659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-064997db-1998-4446-a674-3f670eac5a29 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1214 microversion: 2.1 time: 0.270391 Aug 30 16:17:23.476712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 18/27] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:23 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:23.606334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] validate_networks() for [('263eb0c3-89d1-4ff2-8ff6-6433b63ba805', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:24.275573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:24.276701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:24.277335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:24.277886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:24.278493 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:24.307490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.312253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.312793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.314285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.314975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.315253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.329779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1205801449", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:24.370652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for project d07b587d6ac148b0a7751c851260b3bc. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:24.391540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for user c3dc3a92c6424cdbb3a2d3c1baaa95e3 and project d07b587d6ac148b0a7751c851260b3bc. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:24.425520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:24.431942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:24.561223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] validate_networks() for [('5497bee0-c4eb-4a90-ba93-1b1cfe8484bb', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:24.573235 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3aa3ddf6-e301-461a-8301-4087ca320263 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.272491 Aug 30 16:17:24.574137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 10/28] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 30 16:17:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 16:17:24.761840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92f9d8cc-24fc-49a1-b4b6-5ae8444c0443 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: .version_select at 0x7f1267248af0>, body: {"keypair": {"name": "tempest-keypair-1843169632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDk2/slCWvr/ksjDHLNsyU6bhzzDqONjxYdsptX/fFrS72636gZdhSAsRwxOmsC9lxn6u3saQiyi1GR2kBjW5Tq+jRZK872nlRSP3rhrJrLzbiu6HVVJazMl9XfXvqIDg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:24.826979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-92f9d8cc-24fc-49a1-b4b6-5ae8444c0443 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:24.851700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-92f9d8cc-24fc-49a1-b4b6-5ae8444c0443 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for user ecf0e8a3fae04b499310fe0d35c08269 and project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:24.972129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92f9d8cc-24fc-49a1-b4b6-5ae8444c0443 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.393921 Aug 30 16:17:24.983246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 11/29] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:17:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:24.988649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92df1891-24e4-4467-846f-9b0843c5d738 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.989276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92df1891-24e4-4467-846f-9b0843c5d738 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:25.349052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92df1891-24e4-4467-846f-9b0843c5d738 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.445608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92df1891-24e4-4467-846f-9b0843c5d738 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1214 microversion: 2.1 time: 0.457957 Aug 30 16:17:25.448784 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 12/30] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:24 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1214 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:25.463821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:25.467151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:25.699124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.714740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.722423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.731008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaddca2c-f982-45a3-b44b-2ba6cd4980d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1280 microversion: 2.20 time: 0.274194 Aug 30 16:17:25.731667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 13/31] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:25 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:26.472492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:26.476275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:26.497782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:26.498326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:26.498780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:26.499771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:26.523787 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:26.527180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.013087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:27.014313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:27.014804 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:27.015234 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:27.015669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:27.048516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.049017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.052436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.053515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.054625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.055246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.171190 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:27.190691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for user 03eed7086183469f8cc1e765422bea87 and project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:27.231040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:27.240221 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:27.442718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6079a8ef-8e6b-41b5-bf74-adce7038d949 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.855874 Aug 30 16:17:27.444053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 19/32] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:17:27.477464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:27.478117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:27.509887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.510434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.510876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.512163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.513009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.515367 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.595358 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:27.620248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccdc5f03-dc1d-4345-b6e0-39d51b08eadb tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1266 microversion: 2.1 time: 1.153133 Aug 30 16:17:27.635704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 14/33] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:26 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1266 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:27.645573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0b78839-5422-4e52-b5e3-05b3b0b6bb69 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:27.645720 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0b78839-5422-4e52-b5e3-05b3b0b6bb69 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:27.865698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0b78839-5422-4e52-b5e3-05b3b0b6bb69 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:27.874115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0b78839-5422-4e52-b5e3-05b3b0b6bb69 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1222 microversion: 2.1 time: 0.236273 Aug 30 16:17:27.882510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 15/34] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:27 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:28.143391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1873160372", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:28.280266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] validate_networks() for [('5497bee0-c4eb-4a90-ba93-1b1cfe8484bb', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:28.603936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:28.659979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:28.663847 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:28.670598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-dca4696a-ebdf-42ba-bcea-44bd1cfd1a20 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1276 microversion: 2.20 time: 1.222006 Aug 30 16:17:28.671867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 20/35] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:27 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1276 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:28.680989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:28.681854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:28.701378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:28.702284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:28.702984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:28.703938 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:28.705929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:28.706559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:28.869323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:28.883088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e791ae6d-78ae-4948-96ec-49e9a48a5893 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1272 microversion: 2.1 time: 0.209165 Aug 30 16:17:28.889905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 21/36] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:28 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:29.968191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a851c58e-1493-4969-95c5-9e526e2e4589 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Action: 'create', calling method: .version_select at 0x7f1267107550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1639174270", "metadata": {"Type": "work"}}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a851c58e-1493-4969-95c5-9e526e2e4589 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 122 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:29.973820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1639174270", "metadata": {"Type": "work"}}} Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:29.975313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1639174270', 'metadata': {'Type': 'work'}}}} Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:29.976075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:17:29.977220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:17:29.978200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:17:29.978200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:29.984428 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a851c58e-1493-4969-95c5-9e526e2e4589 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:29.985817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a851c58e-1493-4969-95c5-9e526e2e4589 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.094497 Aug 30 16:17:29.987726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 22/37] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 30 16:17:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1097 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:30.016360 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.019443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:30.050934 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.052411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.054157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.056296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.058186 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.060040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.145449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:30.145965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:30.147119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:30.147644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:30.148305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:30.164504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.165500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.167783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.168976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.171439 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.172067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.220792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:30.227957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for user 03eed7086183469f8cc1e765422bea87 and project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:30.251819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:30.271102 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:30.278819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:30.287519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:30.289591 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8b17b015-ee78-41d7-974b-56c1724ff027 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1340 microversion: 2.20 time: 0.290052 Aug 30 16:17:30.308794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:30.309467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 23/38] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:29 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1340 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:30.337474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.338109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:30.357773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.358279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.358759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.359440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.366113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.370278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.498294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f34dca1-dcfe-4b2a-a757-4fc9453734d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.355797 Aug 30 16:17:30.498922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 16/39] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:17:30.522093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c071c296-f85d-44df-81c9-c199d24b772f tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Action: 'create', calling method: .version_select at 0x7f12671b2310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2098374665", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c071c296-f85d-44df-81c9-c199d24b772f tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 120 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:17:30.545506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2098374665", "metadata": {"Type": "work"}}} Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: Aug 30 16:17:30.546984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2098374665', 'metadata': {'Type': 'work'}}}} Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '0' Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:30.547850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:17:30.549019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:17:30.550597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:17:30.550597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.551926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c071c296-f85d-44df-81c9-c199d24b772f tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:30.555043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c071c296-f85d-44df-81c9-c199d24b772f tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.046280 Aug 30 16:17:30.557558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 17/40] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 30 16:17:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:30.569736 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0bbd1a3-7dda-4ef1-972c-d4f739e929d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.570205 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0bbd1a3-7dda-4ef1-972c-d4f739e929d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:30.762515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0bbd1a3-7dda-4ef1-972c-d4f739e929d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:30.772121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0bbd1a3-7dda-4ef1-972c-d4f739e929d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1222 microversion: 2.1 time: 0.211626 Aug 30 16:17:30.789525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 18/41] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:30 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:30.802392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c3a254-a4dc-49a6-8c1e-3bc3644771c5 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Action: 'create', calling method: .version_select at 0x7f1267108940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1558939223", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c3a254-a4dc-49a6-8c1e-3bc3644771c5 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 119 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:17:30.813323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1558939223", "metadata": {"Type": "work"}}} Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: Aug 30 16:17:30.814698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1558939223', 'metadata': {'Type': 'work'}}}} Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:30.819835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:17:30.821890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:17:30.823005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:17:30.823005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.823005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c3a254-a4dc-49a6-8c1e-3bc3644771c5 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:30.823005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7c3a254-a4dc-49a6-8c1e-3bc3644771c5 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023694 Aug 30 16:17:30.823321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 19/42] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 30 16:17:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:30.835459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5411a6e5-9188-4683-b0dc-d3190d2b2a46 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Calling method '.version_select at 0x7f12671b28b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.886840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:30.889836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5411a6e5-9188-4683-b0dc-d3190d2b2a46 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] HTTP exception thrown: Volume tempest-invalid-1317642554 could not be found. Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5411a6e5-9188-4683-b0dc-d3190d2b2a46 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1317642554 HTTP/1.1 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:17:30.894738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Volume tempest-invalid-1317642554 could not be found. Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'tempest-invalid-1317642554'} Aug 30 16:17:30.896008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1317642554 could not be found. (HTTP 404) (Request-ID: req-ae9f4d57-af03-46df-967b-f55b3554181b) Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.896716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:30.897660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1317642554 could not be found. Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:30.898917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1317642554 could not be found. Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1317642554 could not be found. Aug 30 16:17:30.900078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:30.900629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9e647575-54f9-4374-b3d8-5130f531e439 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.585935 Aug 30 16:17:30.902457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5411a6e5-9188-4683-b0dc-d3190d2b2a46 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 404 to user: Volume tempest-invalid-1317642554 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:30.903671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5411a6e5-9188-4683-b0dc-d3190d2b2a46 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1317642554" status: 404 len: 99 microversion: 2.1 time: 0.079254 Aug 30 16:17:30.904919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:30 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:30.912176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 20/44] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 30 16:17:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1317642554 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:17:30.923545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e430b8a3-28a4-4f27-b5f0-df2e82e7b67b tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005997 Aug 30 16:17:30.928398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 25/45] 10.222.0.57 () {58 vars in 1140 bytes} [Tue Aug 30 16:17:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:17:30.933682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9035272f-2c73-4472-bf05-08f6fd0c4a05 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004239 Aug 30 16:17:30.938639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 21/46] 10.222.0.57 () {58 vars in 1137 bytes} [Tue Aug 30 16:17:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:17:30.949773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ee5a1243-1247-4456-beb2-7a609b25d04c tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Calling method '.version_select at 0x7f1267107550>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.021941 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-ee5a1243-1247-4456-beb2-7a609b25d04c tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] HTTP exception thrown: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ee5a1243-1247-4456-beb2-7a609b25d04c tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/os-volumes/2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 HTTP/1.1 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:17:31.024289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5'} Aug 30 16:17:31.025534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. (HTTP 404) (Request-ID: req-85f30be2-4580-4941-9285-8b2ae2ea6a7f) Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.026314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:17:31.027458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:17:31.028462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. Aug 30 16:17:31.029671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.030898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ee5a1243-1247-4456-beb2-7a609b25d04c tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 404 to user: Volume 2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:31.032560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ee5a1243-1247-4456-beb2-7a609b25d04c tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5" status: 404 len: 109 microversion: 2.1 time: 0.089279 Aug 30 16:17:31.033638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 26/47] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:17:30 2022] DELETE /compute/v2.1/os-volumes/2ae22a06-e53f-4f28-9cbc-200c8a4fa1b5 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:31.046122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae28e5a6-b811-40c4-afa3-be18e1aa7652 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Calling method '.version_select at 0x7f1267094310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.110069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ae28e5a6-b811-40c4-afa3-be18e1aa7652 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] HTTP exception thrown: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae28e5a6-b811-40c4-afa3-be18e1aa7652 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Request method failure captured: Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/33e59137-6c21-4631-a2fe-374bacdda4d4 HTTP/1.1 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgYLbbkWvirX-K4z-WRD-qpUp_o-PMzFDxhx9bNFE1OnRl3ElGmrAdBujqtwiOVaeQcVoc68CdsF69xYqnUlwJdCwTJLVybNY0IPWOw-0_px0nc7V5gXYQn0wV3_lXSWwBSH54K0b_0g7h4t6-UhyduM0n2cUlZxYdF0lfl1ITXYIU Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:17:31.112682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1437e428c0ef4f7daa655211a73c9664"}]}] Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1437e428c0ef4f7daa655211a73c9664 Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-1101609145 Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 453f0791592c413da9a2399a61c7ec38 Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-1101609145-project Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '33e59137-6c21-4631-a2fe-374bacdda4d4'} Aug 30 16:17:31.114322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. (HTTP 404) (Request-ID: req-4bcae31b-6d6d-4d38-8fd8-485ad4bab195) Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.115146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:17:31.116774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:17:31.118058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae28e5a6-b811-40c4-afa3-be18e1aa7652 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] Returning 404 to user: Volume 33e59137-6c21-4631-a2fe-374bacdda4d4 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae28e5a6-b811-40c4-afa3-be18e1aa7652 tempest-VolumesNegativeTest-1101609145 tempest-VolumesNegativeTest-1101609145-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/33e59137-6c21-4631-a2fe-374bacdda4d4" status: 404 len: 109 microversion: 2.1 time: 0.077293 Aug 30 16:17:31.128565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 22/48] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/os-volumes/33e59137-6c21-4631-a2fe-374bacdda4d4 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:31.316214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.317310 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:31.332173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.335242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.337399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.339895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.341759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.343405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.491859 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.511377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.518452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.525306 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c00245a0-9d3d-4b89-95f8-631559e99887 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1340 microversion: 2.20 time: 0.213819 Aug 30 16:17:31.540396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 27/49] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1340 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:31.794120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.801343 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1523003947", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de00c1cc-2bdc-42b7-bcad-30bc1d706f70"}], "security_groups": [{"name": "tempest-securitygroup--1971813644"}], "key_name": "tempest-keypair-1843169632", "user_data": "}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:31.801747 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:31.815881 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.816372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.816810 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.817564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.818019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.818445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.933716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.956727 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ce35911-f134-4f78-8cb6-7253dcf203a7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1226 microversion: 2.1 time: 0.166367 Aug 30 16:17:31.970695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 23/50] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:31.979009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.980021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:31.987730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.988626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.989363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.990217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.990999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.991926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.117304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] validate_networks() for [('de00c1cc-2bdc-42b7-bcad-30bc1d706f70', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:32.317045 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:32.336032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8067cacb-3af5-4829-8526-9590c0b2102c tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.363806 Aug 30 16:17:32.337433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 24/51] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:32.551949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.552609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.571365 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.572548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.573120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.580559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.583894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.584571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.750948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:32.778138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:32.782254 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:32.785196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa88d892-6a2d-438b-8336-34f6625135b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1340 microversion: 2.20 time: 0.237924 Aug 30 16:17:32.786110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 25/52] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1340 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:32.921046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:32.921818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:32.922762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:32.923940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:32.924602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:32.938151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.938965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.939626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.941539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.942506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.943153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.967911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:32.974339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for user ecf0e8a3fae04b499310fe0d35c08269 and project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:32.982967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.984534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:33.002247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.004239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.005628 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:33.008112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.009215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:33.009884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.010381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.012424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.131042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5c70c37d-4cd6-4db0-909d-ae1eda603583 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.334835 Aug 30 16:17:33.140125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 28/53] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:17:33.152056 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a3f421e2-0ff7-4f0e-9b12-92412e9beee7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.157108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a3f421e2-0ff7-4f0e-9b12-92412e9beee7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:33.230280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.256442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85da0f2f-d97e-44d3-8f10-421a974446fc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1226 microversion: 2.1 time: 0.273140 Aug 30 16:17:33.261405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 26/54] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1226 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.320510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3f421e2-0ff7-4f0e-9b12-92412e9beee7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.334465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a3f421e2-0ff7-4f0e-9b12-92412e9beee7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1238 microversion: 2.1 time: 0.191255 Aug 30 16:17:33.363860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.364753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:33.368823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 29/55] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1238 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.377874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.380654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.381834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.384797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.386472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.390133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.818309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.819793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:33.835311 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.838059 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.840258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.841191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.843831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.848261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.045760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.059604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4ebc2a1-9755-46b9-9133-b68254ba16cc tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.705230 Aug 30 16:17:34.082329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 27/56] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:34.188827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.228692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.261241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.269736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-066c189c-b115-4e06-853b-e8ee0cb64d60 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1350 microversion: 2.20 time: 0.455757 Aug 30 16:17:34.271288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 30/57] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1350 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:34.294952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.300105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:34.316521 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.317386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.318232 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.321267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.323576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.329961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.367145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-143b5002-92ab-45a5-b17c-83c8b065a112 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.388939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-143b5002-92ab-45a5-b17c-83c8b065a112 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:34.545155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.561631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11f5f566-3d80-49e6-a243-dde1cb180327 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1274 microversion: 2.1 time: 0.270543 Aug 30 16:17:34.562263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 28/58] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:35.084288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.084949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.095338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.095879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.096327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.099933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.100396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.100840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.119582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-143b5002-92ab-45a5-b17c-83c8b065a112 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.130733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-143b5002-92ab-45a5-b17c-83c8b065a112 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1238 microversion: 2.1 time: 0.767876 Aug 30 16:17:35.132091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1238 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:35.298227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.298843 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.340833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.343652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.347673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.366407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.371461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.375204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.428703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.441938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3320d461-7d8a-4664-9849-ca2f711edd88 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.361625 Aug 30 16:17:35.458025 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 29/60] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:35.561163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.585512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.586686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.590373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.597746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.598647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.599875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.600859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.600987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.601797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.602829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.613906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1d808438-044c-4c47-b5aa-208e97bb0229 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1338 microversion: 2.20 time: 0.317950 Aug 30 16:17:35.617482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 32/61] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:35.746781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.758903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e22d2dd0-187b-4434-a15d-dbb9cfddc6dc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1274 microversion: 2.1 time: 0.178151 Aug 30 16:17:35.774194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 30/62] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:36.159257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:36.159257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:36.165257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.165749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.166183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.166891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.182891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.187125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.465636 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:36.467738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:36.493267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.493884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.497307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.500003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.505328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.506197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.664940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.692010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d34d4b36-42ee-49f9-8f9e-98106bcc1f47 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.541793 Aug 30 16:17:36.694279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 33/63] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:36.700665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:36.702108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:36.730382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.731628 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.733368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.734522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.736704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.737474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.966050 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.978576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.986831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.988085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f8951720-5ecf-4491-8787-82a535f0a99c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1338 microversion: 2.20 time: 0.292333 Aug 30 16:17:36.988655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 34/64] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:36.993684 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:37.000538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:37.002919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:37.022796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.023689 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.024364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.025320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.026061 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.026745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.265365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:37.303352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4e7053ab-e60b-41ec-9d73-998b877823e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1280 microversion: 2.1 time: 0.313202 Aug 30 16:17:37.304072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 35/65] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:37.398468 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:37.407426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb1e743d-ceac-4e3d-8db2-5bca123477f1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.945884 Aug 30 16:17:37.418219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 31/66] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:37.718462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:37.719911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:37.728505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.741467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.742006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.743014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.743662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.744190 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.954350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:37.971522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2d3f25d3-dc5e-4bfd-a44e-4fafceea7beb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.257125 Aug 30 16:17:37.995507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 36/67] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:37 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:38.012023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.013340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:38.022332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:38.025142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.027833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.028477 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.029901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.035429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.036214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.184027 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503606c2-4601-45a5-b761-95d70e8bf121", "tag": "b00674f6-5432-48ae-8387-63f22819df14"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:38.198589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.199154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.199539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.222117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Creating event network-changed:b00674f6-5432-48ae-8387-63f22819df14 for instance 503606c2-4601-45a5-b761-95d70e8bf121 on hv-cinder-85220 Aug 30 16:17:38.222405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:17:38.222980 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-3fedee10-a12a-4866-baaf-f7ba213fa5e2 req-7b098d1c-9a3f-48a7-bd36-2eb95802847a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:17:38.224402 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.224866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.225464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.226360 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.226996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.227769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.236859 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.compute.rpcapi [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 16:17:38.238013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] Releasing lock "compute-rpcapi-router" {{(pid=120589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:17:38.258583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c7580170-ff52-4023-b322-da6a4d2b7509 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174252 Aug 30 16:17:38.259204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 37/68] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:38.333394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.334502 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:38.344962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.345793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.346442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.347449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.349009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.349706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.394532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.406699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.408397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.414805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2038ceb-ce1b-4f54-aff7-d597eb0969c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.406606 Aug 30 16:17:38.416269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 32/69] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:38.430394 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.431419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:38.438823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.439568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.440424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.441608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.442272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.442800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.585235 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.593189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4dde753-763b-43ea-a528-d4d0239f1ed8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.166932 Aug 30 16:17:38.593776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 33/70] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:38.656258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.664702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-cd974b7d-9664-4ede-ae9f-34dc22300208 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.336159 Aug 30 16:17:38.665841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 38/71] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:38.994110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.994716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:39.003570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.004151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.004599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.005498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.005958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.006392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.073167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.081360 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32e812d9-f3b3-478e-8a43-bdfdf2997310 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.090988 Aug 30 16:17:39.081927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 34/72] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:39.439793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:39.440345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:39.446332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.446818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.447281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.447973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.448427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.448851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.582729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.590826 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.592304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.593408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ab7a7625-5786-41ac-80ff-8c881b3cfa50 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.158122 Aug 30 16:17:39.593966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 39/73] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:39 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:39.613357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:39.613968 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:39.620039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.620521 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.620960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.621654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.622115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.623029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.687054 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:39.687702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:39.693880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.694309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.694748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.695471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:39.695930 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:39.696364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.759982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.768491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce024e66-2e38-4ac9-8318-b854c2169ac8 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.158901 Aug 30 16:17:39.769068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 35/74] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:39 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:39.830787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:39.838526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-75d301c3-ef55-4bbd-ab97-f1ec7e9766b3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.155296 Aug 30 16:17:39.839096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 40/75] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:39 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:40.102015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.102623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:40.108663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.109150 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.109628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.110334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.110789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.111209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.172662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.180486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6340ed06-c150-4187-99e9-3591249706da tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.082309 Aug 30 16:17:40.181063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 36/76] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:40 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:40.616150 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.616720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:40.623335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.623814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.624246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.625189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.625633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.626046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.753643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.762078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.763708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.764812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1a4d72c4-7425-4c3f-9014-375c1d36c8a8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.152680 Aug 30 16:17:40.765365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 41/77] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:40 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:40.789808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.790397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:40.792243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.792915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=30 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.799627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.800110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.800545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.801237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.801695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.802121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.822461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.860331 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.861030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:40.867143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.867581 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.868014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.868697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.869145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.869567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.873830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.946302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.955419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4215877e-21f2-422e-80c5-7f00e85f8f8d tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.169302 Aug 30 16:17:40.956084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 37/78] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:40 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:41.049151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.069869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-25897952-9f0d-4c11-b0fd-a3f731f9bc41 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.213760 Aug 30 16:17:41.081955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 42/79] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:40 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:41.204099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:41.204872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:41.212744 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.213499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.214112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.215363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.215688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.216116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.285189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.297437 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7fbbc1c2-5a0a-41cc-b53f-c704a30a89eb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.098080 Aug 30 16:17:41.298286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 38/80] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:41 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:41.790547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:41.791374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:41.797432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.798239 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.798679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.799592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.800178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.800608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.978234 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.979865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:41.980871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:41.989921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.990673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.991636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.991769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.992322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.993150 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8307d1e6-d2b1-4110-999c-346ba0ab45f1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.209698 Aug 30 16:17:41.993482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.993934 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 43/81] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:41 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:41.994416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.994865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.092182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:42.097011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:42.105055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.110677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.111439 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.112887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.113508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.120817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.277807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:42.288434 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b9cb8b9-429e-402a-8fa9-271c3f14a369 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.313977 Aug 30 16:17:42.300472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 39/82] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:41 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:42.322385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:42.323381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:42.331122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.331829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.332438 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.333318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.333935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.334510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.461431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:42.471545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-002b7ff3-bbeb-4e7b-9dee-4a7415d8d55d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.152876 Aug 30 16:17:42.485723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:42.493214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 40/83] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:42 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:42.496260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0761ccf4-6757-4448-a969-039ef5b4044c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.407872 Aug 30 16:17:42.498928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 44/84] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:42 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:43.016954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:43.017811 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:43.024173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.024802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.025360 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.026160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.026897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.027909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.197199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.207179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.209105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.210672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d8dd71d-c734-4813-b08a-339d397be4a2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.198080 Aug 30 16:17:43.211738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 41/85] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:43 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:43.323249 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:43.323853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:43.339533 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.342781 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.343191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.344069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.344427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.344854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.496665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:43.498220 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:43.506269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.507031 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.507568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.508346 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.508875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.509428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.562385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.576261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-00b0236f-5b0e-4ec8-a55e-4909d17cc6f0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.252004 Aug 30 16:17:43.585478 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 45/86] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:43 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:43.590845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:43.593029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:43.602872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.605654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.606405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.610273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.610551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:43.611256 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:43.612605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.623356 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae7da09f-f28a-4f03-b060-922aa5194850 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.130679 Aug 30 16:17:43.630717 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 42/87] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:43 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:43.914890 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:43.962510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b5d7196b-d361-4fa0-91da-a44496ced834 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.377949 Aug 30 16:17:43.967790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 46/88] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:43 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:44.234585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:44.235510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:44.247896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.249400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.251251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.254384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.255093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.255769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.602681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:44.604558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:44.619871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.628679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.629460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.631193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.634327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.635036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.658407 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:44.672789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:44.674274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:44.675477 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c8fc819-70d9-4064-8eef-2fda4869272a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.445693 Aug 30 16:17:44.676030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 43/89] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:44 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:44.709888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:44.710839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:44.718337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.719322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.720137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.721958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.728302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.729119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.870838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:44.885638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3d5402d-f836-4fb2-9a65-123e9906f37a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1290 microversion: 2.1 time: 0.186404 Aug 30 16:17:44.886208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 44/90] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:44 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1290 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:45.000327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:45.000906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:45.017633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.018354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.019042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.020112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.020953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.021796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.093653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:45.108286 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-985b22d4-fc81-4291-a81b-2fb447795296 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.510532 Aug 30 16:17:45.111535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 47/91] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:44 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:45.510677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:45.519425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea339b5e-bc3f-4375-a5b7-c36210433d3e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.524879 Aug 30 16:17:45.520020 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 45/92] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:44 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:45.698212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:45.698856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:45.712951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=22 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:45.723708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.728351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.728869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.730878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.731392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.736607 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.915359 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:45.916719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:45.949934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.951183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.953498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.960385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.961120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.962327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.503905 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:46.519499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35e13879-37b5-4d14-9e6a-e7956af6b4f9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1298 microversion: 2.1 time: 0.608937 Aug 30 16:17:46.521123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 46/93] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:45 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1298 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:46.528946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:46.530123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:46.538414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.539835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.541070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.542399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.543282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.543948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.694687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:46.729435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:46.736669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:46.742941 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-44a1367d-81ba-44c7-aae8-788dadf353b1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 1.046958 Aug 30 16:17:46.744590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 48/94] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:45 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:46.760783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:46.761629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:46.771952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.772767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.773358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.774319 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.775154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.775833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.036730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:47.055855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-339617d8-46e0-4eeb-9714-f873cab5eab1 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.529424 Aug 30 16:17:47.057032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 47/95] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:46 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:47.257002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:47.264725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9ea8d70c-c599-43b1-8f0b-8c616be1926c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.517604 Aug 30 16:17:47.268877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 49/96] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:46 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:47.540604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:47.541418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:47.549726 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:47.550231 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:47.550660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.551403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:47.551868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:47.552303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.647362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:47.662574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25218707-6a02-4256-83ad-ffb53544f209 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1296 microversion: 2.1 time: 0.125475 Aug 30 16:17:47.665024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 48/97] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:47 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:47.779711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa19fe1-b789-43c1-8471-ee231a65cc92", "tag": "4955ad3e-aca3-4c8e-860c-51796f3b6f8d"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:47.785401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:47.786409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:47.792835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:47.795801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:47.796416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.797302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:47.799157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:47.800015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:47.800683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.803335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:47.803949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.833838 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] Creating event network-changed:4955ad3e-aca3-4c8e-860c-51796f3b6f8d for instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 on hv-cinder-85220 Aug 30 16:17:47.843173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-652df08e-85bd-4ca3-a4a8-14cacb8bf94a req-5e994112-c5b7-4415-984b-0f8170d8421f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285500 Aug 30 16:17:47.844425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 50/98] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:48.083706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:48.085917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:48.101136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.101883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.105651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.107528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.108275 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.109026 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.204299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.220428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.222211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.232675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a288d2da-1594-4a45-ba54-d9dc455ef80c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.454500 Aug 30 16:17:48.248106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:48.248366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 49/99] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:47 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:48.286496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:48.287508 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:48.296274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.297072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.297831 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.298767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.299541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.300662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.679372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.688393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-558f47c1-b5c6-4b97-9ba5-6016498581e9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.406209 Aug 30 16:17:48.699658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 50/100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:48 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:48.702154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.710538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-08526f64-23c6-465a-8203-5308631b8304 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.636811 Aug 30 16:17:48.714884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 51/101] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:48 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:48.717533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:48.718157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:48.727709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.728207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.728638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.729350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.729807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.730233 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.885046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.895916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-456dab19-8c65-4194-a58f-1ae4fab6f06e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1296 microversion: 2.1 time: 0.181280 Aug 30 16:17:48.897646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 51/102] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:48 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1296 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:49.000667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7002e560-8234-4472-94da-e854fa3aa36c", "tag": "d5153690-2d32-45c8-8e23-5a0c2efd672c"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:49.021898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.022698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.023125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.044069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] Creating event network-changed:d5153690-2d32-45c8-8e23-5a0c2efd672c for instance 7002e560-8234-4472-94da-e854fa3aa36c on hv-cinder-85220 Aug 30 16:17:49.061251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-65cf1193-0c44-4fa4-a7d0-1f6f89ba01fe req-dac47e8d-e7ce-4291-b4ed-abf31a3401bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065981 Aug 30 16:17:49.067152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 52/103] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:49.262716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:49.264261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:49.276640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.280274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.281099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.282094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.284459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.285157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.537698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:49.545875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:49.547116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:49.548557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b89bac3-3e68-46d4-8b95-ce50a1bd0967 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.289910 Aug 30 16:17:49.549340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 52/104] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:49 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:49.725077 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:49.726035 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:49.736141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:49.736904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:49.748282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.748677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.749163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.749653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.750492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.751205 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.751678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.752227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.752943 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:49.753395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:49.754888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:49.756158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.011239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.027308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2c1f6e7-0161-4132-84bb-2dc7f0f090ce tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.294223 Aug 30 16:17:50.030136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 53/105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:49 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:50.036213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:50.037244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:50.044568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.045282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.045941 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.068499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.069524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.070385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.078915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:50.131288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.152551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-03b25fe2-e996-4d36-b918-fec8395f4ad0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.431879 Aug 30 16:17:50.153499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 53/106] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:49 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:50.303454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.318453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-488721fd-624e-4ca8-b489-1e64e155f718 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.284533 Aug 30 16:17:50.331504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 54/107] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:50 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:50.577680 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:50.578370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:50.586326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.588477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.589553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.590433 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.591133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.591724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.762692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.774771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.776660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.778007 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-91483216-670c-4371-934a-36a066e5d485 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.205943 Aug 30 16:17:50.778600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 54/108] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:50 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:51.054238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:51.055178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:51.063111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.063987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.064742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.065661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.066106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.066632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.127638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:51.137228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.137863 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.138748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.161582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] Creating event network-changed:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:17:51.175288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-2584031f-a468-47aa-a22e-1bc9a6ee15e7 req-07a44051-edcf-4b6b-9c66-913ef472cb58 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052631 Aug 30 16:17:51.176520 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 55/109] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:51.186332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:51.186915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:51.195922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.196787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.197499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.198516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.199175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.199876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.290194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:51.302028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30eed34a-32aa-4411-b50d-0307ead79622 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.253754 Aug 30 16:17:51.303144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 55/110] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:51 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:51.344217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:51.345657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:51.356830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.357537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.358351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.359284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.360408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.361311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.407671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:51.418794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-59ae9a8e-0aed-4753-ae02-04c4eee7a826 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.239730 Aug 30 16:17:51.427813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 56/111] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:51 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:51.552707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:51.571107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6af79c00-3dc7-405b-9b05-04d8386b89b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.229758 Aug 30 16:17:51.573938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:51 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:51.802694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:51.803638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:51.823540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.824037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.824509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:51.825253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:51.826235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:51.826661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.326872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:52.327646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:52.334085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.334578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.338706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.340777 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.342776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.343487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.390104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:52.402255 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:52.404298 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:52.408291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c0a6edc7-9840-44d3-aa34-e68fa0fc1426 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.611062 Aug 30 16:17:52.423549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 57/113] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:51 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:52.439771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:52.440386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:52.448958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.452861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.453515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.454438 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.455750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.457508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.844372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:52.857111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57c89fcb-c841-489d-ad3b-ea1479dd3ea2 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.532164 Aug 30 16:17:52.867914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 57/114] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:52 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:52.880131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:52.881196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:52.887895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.888741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.889508 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.890395 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.891137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.891889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.212053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.230105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9577553c-fb60-4db4-bdab-29c832b8f209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.793286 Aug 30 16:17:53.231566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 58/115] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:52 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:53.312932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.342167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4686cba1-0dbf-4104-a74b-4d34621eb42d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.469459 Aug 30 16:17:53.343726 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 58/116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:52 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:53.430265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:53.431136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:53.446856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.447480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.448148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.449084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.449743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.450895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.861627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.873984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.882888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:53.883879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:53.886126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.892402 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-005028ed-6040-4600-84db-e697cf0f9b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.465128 Aug 30 16:17:53.895236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 59/117] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:53 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:53.901504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.904156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.904731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.905609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.908063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.908969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.210064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70cd69f5-b796-45fb-a89f-d7d39864d2ae", "tag": "1a19abfd-980a-447d-a628-c8d4ce1e2dc0"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:54.225910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.227704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.230030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.275096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] Creating event network-changed:1a19abfd-980a-447d-a628-c8d4ce1e2dc0 for instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae on hv-cinder-85220 Aug 30 16:17:54.287267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-ed441531-158e-4dde-95e9-ac89510b4f90 req-0abc9bb1-56af-4eda-9f8e-128e7ef2d352 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082193 Aug 30 16:17:54.290039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 60/118] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:54.298876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:54.306888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46dd73dd-78d0-40e9-9be0-24229f8c7db9 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.431603 Aug 30 16:17:54.311054 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 59/119] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:53 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:54.315523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:54.317759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:54.329610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.330113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.330551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.331798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.332471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.333107 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.358014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.366161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:54.366783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:54.374307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.374838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.375520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.376228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.376683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.377108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.562236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:54.570735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40bd55d9-9f3a-412a-ad87-406ae8f4452f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.210246 Aug 30 16:17:54.571671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 60/120] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:54 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:54.593034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:54.607328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7f6d2986-3c0c-4a35-b7ab-5f6752f6f570 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.314762 Aug 30 16:17:54.608253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 61/121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:54 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:54.924598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:54.925222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:54.937790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.938309 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.941843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.942725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.944447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.944993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.335079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:55.344565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:55.367379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.369550 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.371820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.373690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.376256 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.377911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.435272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:55.451929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:55.453419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:55.454537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-beb04f09-c7af-4625-b80b-6b8afab8d9c4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.534311 Aug 30 16:17:55.455108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 61/122] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:54 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:55.593732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:55.594570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:55.604207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.604706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.606322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.611347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.612137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.612583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.760837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:55.775082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c798586a-1931-4c78-839f-c8484656a56f tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.445078 Aug 30 16:17:55.776924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 62/123] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:55 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:55.794719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:55.796004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:55.817864 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.818497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.821908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.824911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:55.826847 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:55.829462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:55.929799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:55.944197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91eb0c47-7aef-4b9e-8019-674242f88739 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.355713 Aug 30 16:17:55.945024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 62/124] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:55 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:56.098873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:56.107149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33c1f98e-80d1-4a21-8f06-58b9991e2685 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.326439 Aug 30 16:17:56.108815 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 63/125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:55 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:56.182478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa19fe1-b789-43c1-8471-ee231a65cc92", "name": "network-vif-plugged", "status": "completed", "tag": "4955ad3e-aca3-4c8e-860c-51796f3b6f8d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:56.200147 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.201366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.201984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.224940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Creating event network-vif-plugged:4955ad3e-aca3-4c8e-860c-51796f3b6f8d for instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 on hv-cinder-85220 Aug 30 16:17:56.225808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:17:56.226360 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-35bcf574-b07c-4380-9fe0-2828cd52bafe req-da2836ba-2120-4329-ae0d-b4038400c067 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:17:56.227595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.228225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.228803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.229699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.230295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.230911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.240688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.compute.rpcapi [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 16:17:56.241871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] Releasing lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:17:56.267156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01297259-d836-40b6-a44c-6c158ff9f8ef None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320755 Aug 30 16:17:56.268888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 63/126] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:56.479642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:56.480538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:56.490585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.491515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.492279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.493259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.493915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.494537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.649514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:56.659788 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:56.661617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:56.662884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-98a285db-6907-4a6a-99c0-5c029232ebe3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.188471 Aug 30 16:17:56.675949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 64/127] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:56 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:56.808719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:56.811549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:56.830495 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.832314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.834677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.836645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.837729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.838391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.965143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:56.965882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:56.972914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.973779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.974643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:56.975794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:56.976350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:56.976994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:57.231280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.244132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c38db9f0-0a1c-4b22-a123-24bd0b593476 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.445837 Aug 30 16:17:57.245642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 64/128] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:56 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:57.257429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:57.260925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:57.269878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:57.270811 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:57.271454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:57.272531 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:57.273589 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:57.274022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:57.490079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.510013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5a0dcffd-408c-4b02-8caa-df89741b72fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.548694 Aug 30 16:17:57.526294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 65/129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:56 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:57.536432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.544646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13b8562c-2d9d-4549-8702-ff7ede9e47bf tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.297673 Aug 30 16:17:57.558365 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 65/130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:57 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:57.697187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:57.697748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:57.707320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:57.707768 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:57.712607 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:57.713879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:57.718756 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:57.719204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:57.934274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.946882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.949275 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:57.950582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-681e414d-2a8d-454c-98b9-954eedb7eda9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.257210 Aug 30 16:17:57.951751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 66/131] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:57 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:58.270081 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:58.270791 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:58.285016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.285545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.287413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.289367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.291530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.292189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.298021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503606c2-4601-45a5-b761-95d70e8bf121", "name": "network-vif-plugged", "status": "completed", "tag": "b00674f6-5432-48ae-8387-63f22819df14"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:58.315856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.322126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.322905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.355549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] Creating event network-vif-plugged:b00674f6-5432-48ae-8387-63f22819df14 for instance 503606c2-4601-45a5-b761-95d70e8bf121 on hv-cinder-85220 Aug 30 16:17:58.369400 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-ae61f656-c093-46f0-98fb-aa9b095f9c9d req-b0de7978-bb30-456d-881d-16fd3d83c8f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076914 Aug 30 16:17:58.370650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 67/132] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:58.535448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:58.536157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:58.549598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.553041 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.553537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.562200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.562706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.563146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.584912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:58.597080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28478ec8-c0fc-4ab4-9a3a-d70b9caaa8d3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.329581 Aug 30 16:17:58.598090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 66/133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:58 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:58.609272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:58.610000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:58.626606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.628713 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.629408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.631731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.632785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.634122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.822905 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:58.834850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44e960d6-bdfc-4a69-a940-5e937dd957ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.233953 Aug 30 16:17:58.847251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:58 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:58.973979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:58.975455 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:58.983277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.984154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.985705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.986949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.987873 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.988622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.036072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:59.043851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-48254d9a-c501-4f1f-b7d4-9d6c73655ec5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.514363 Aug 30 16:17:59.044508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:58 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:59.385988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:59.402995 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:59.405418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:59.407291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02240bc9-2c90-4f37-b42c-2ed828cf840f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.438293 Aug 30 16:17:59.412924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 68/136] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:17:58 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:59.624761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:59.627493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:59.640255 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.642500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.643658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.646198 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.648093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.650868 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.860261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:59.861449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:59.870527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.871018 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.871479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.877605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.878243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.881680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.082926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.105893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19c05b89-bad6-4b9d-bdb8-793352d70c5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.249904 Aug 30 16:18:00.107296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.108472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 69/137] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:59 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:00.115467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:00.116095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:00.122630 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:00.123646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:00.124242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.125357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:00.125817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:00.126337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.131318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-02da2219-f7bc-4a81-adfa-9b84fd13badd tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.510984 Aug 30 16:18:00.131318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 69/138] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:59 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:00.278121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.293785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a601e88-53cf-4a51-8042-580af890d562 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.184076 Aug 30 16:18:00.295039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 70/139] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:00 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:00.389469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7002e560-8234-4472-94da-e854fa3aa36c", "name": "network-vif-plugged", "status": "completed", "tag": "d5153690-2d32-45c8-8e23-5a0c2efd672c"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:00.401003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:00.401473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:00.402059 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.414052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] Creating event network-vif-plugged:d5153690-2d32-45c8-8e23-5a0c2efd672c for instance 7002e560-8234-4472-94da-e854fa3aa36c on hv-cinder-85220 Aug 30 16:18:00.419100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-25383aa8-908a-4ab6-96d4-101e0f6fdb02 req-aef5c6c8-ee2d-4768-87da-e358d37406d8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 Aug 30 16:18:00.420240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 70/140] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:00.433965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:00.435098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:00.441294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:00.441775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:00.442397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.443260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:00.443907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:00.444332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:00.448513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:00.596384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.610449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.620137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:00.624580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0624d490-db03-47f5-b24b-c7e28ff14846 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.194223 Aug 30 16:18:00.626674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 71/141] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:00 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:01.138743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:01.139686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.153408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:01.154461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.154555 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.155628 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.157701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.158771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.159678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.160586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.177885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.183085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.183725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.188330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.189041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.190103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.436080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:01.445484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58e064f4-d8d8-450c-8d74-54f9f042ad1e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.297803 Aug 30 16:18:01.446803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 72/142] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:01.452652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:01.453512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.460362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.461294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.461952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.462844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.463506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.464127 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.734956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:01.749733 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cff3429f-8efb-44c1-be07-b04f63a79302 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.299036 Aug 30 16:18:01.769122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 73/143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:01.785024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:01.788194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:01.788705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.796961 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a7156da6-354e-41b7-a22b-2086fcd348c3 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.665060 Aug 30 16:18:01.804462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.805785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 71/144] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:01.806680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.808904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.813144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.813813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.815182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.205901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:02.215043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:02.217313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:02.218604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a0d46b3-e2e5-4619-8b96-733723d0a1ec tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.446812 Aug 30 16:18:02.219161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 74/145] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:02.468272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.469032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:02.476779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.477345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.478485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.479436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.480088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.481160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.700976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:02.711483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b06703a5-3b17-4abd-967b-007bdbb8e410 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.249230 Aug 30 16:18:02.725722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:02 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:02.776010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.777563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:02.786981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.787767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.788629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.789537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.790544 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.791148 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.829937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.831146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:02.843485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.843998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.847445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.848712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.849196 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.849629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.024409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.033235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c8cea0dd-bc34-4b11-a699-143896de992a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.209491 Aug 30 16:18:03.047802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 73/147] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:02 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:03.240787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:03.241396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:03.248451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.249185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.249792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.250901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.251531 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.252610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.274605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.284591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e9815d9-b03f-40c5-bc2a-2538cf4a8fc1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.515247 Aug 30 16:18:03.285183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 75/148] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:02 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:03.542560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.563942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.568258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.571635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d9ec5e1b-7359-49a3-8a8c-63cda3871e41 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.334664 Aug 30 16:18:03.584401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 74/149] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:03 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:03.733889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:03.735251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:03.741148 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.741715 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.742244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.743202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.743749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.744243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.879931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:03.890907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85766505-e2d5-46bf-add4-a70069474ac3 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.161679 Aug 30 16:18:03.891539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 76/150] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:03 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:04.057814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:04.058420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:04.065595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.066279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.066705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.067491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.067935 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.068507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.213460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.223910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-72569c76-b3aa-4024-9af0-62e3b0278b01 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.173292 Aug 30 16:18:04.225159 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 75/151] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:04 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:04.307368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:04.307974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:04.315345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.316444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.317055 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.317895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.318484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.318911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.461094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.469443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc6296c8-c08d-4771-b707-a1563dfde43f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.166865 Aug 30 16:18:04.470276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 77/152] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:04 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:04.596796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:04.598105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:04.608327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.610399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.610883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.611853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.612428 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.613767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.803209 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.812878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.814442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.815589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-77af39af-99e0-4f5b-a841-9b07f2cdd1cb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.222636 Aug 30 16:18:04.816323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 76/153] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:04 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:04.911264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:04.912010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:04.920170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.920658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.921256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.921955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:04.922404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:04.922842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.070670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.081624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3be36f27-af2b-49e7-b8db-2011b42ad394 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.174086 Aug 30 16:18:05.082471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 78/154] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:04 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:05.246836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:05.247688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:05.254714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.255204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.255659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.256675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.257322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.257745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.440626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.448261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-40c6b638-31fd-4903-8a93-97f8d953277b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.206215 Aug 30 16:18:05.448843 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 77/155] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:05 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:05.490689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:05.491431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:05.497298 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.497777 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.498203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.498915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.499389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.499827 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.640518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.649582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-415b5ead-b743-470f-8541-fe5e3028b29a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.162666 Aug 30 16:18:05.650265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 79/156] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:05 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:05.837929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:05.839060 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:05.845362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.845846 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.846278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.846966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.847450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.847874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.980456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.988862 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.990306 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:05.991504 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c0e78bcd-41b1-482f-bb63-700d8e3d559f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.157521 Aug 30 16:18:05.992067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 78/157] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:05 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:06.101986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:06.102626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:06.108703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.109187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.109623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.110303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.110754 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.111176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.236696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:06.238839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:06.245681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1837e067-61fe-43ae-ac08-ccacfa074656 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.147537 Aug 30 16:18:06.246256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 80/158] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:06 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:06.471288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:06.471923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:06.477942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.478854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.478854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.479583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.480044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.480473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.499589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:06.611203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:06.618826 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-80ccfd5b-fc4c-42dd-b32d-c6878fcdf5ed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.151501 Aug 30 16:18:06.619441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 79/159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:06 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:06.670994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:06.671636 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:06.677522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.677999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.678433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.679114 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:06.679591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:06.680157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.850008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:06.858303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-333f454b-4bef-460d-8c9a-980dd4b618c1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.191765 Aug 30 16:18:06.858862 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 81/160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:06 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:07.013136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:07.013918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:07.020172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.020655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.021446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.021777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.022203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.022621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.160355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:07.169285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:07.170750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:07.171964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ca1f5efd-7ea0-49eb-a070-01839252f1fe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.163006 Aug 30 16:18:07.172699 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 80/161] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:07 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:07.256911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "name": "network-vif-plugged", "status": "completed", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:07.265877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:07.268004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:07.268563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.268820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:07.269227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.269941 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.271032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=92 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:07.276813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.277332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.280894 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.281899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.282589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.283240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.283600 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] Creating event network-vif-plugged:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:18:07.292957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-599e3d11-1581-4afb-aef3-bd63a9a41934 req-6bb1c4e1-7bab-4ce7-8ad2-b486162af579 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039680 Aug 30 16:18:07.296629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 82/162] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:07.424519 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:07.432395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c4f4e9c6-733d-49a1-9c3a-ab0d1a544d30 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1314 microversion: 2.1 time: 0.170338 Aug 30 16:18:07.432966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 81/163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:07 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:07.641654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:07.642344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:07.648899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.649067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.649510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.650186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.650633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.651051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.784140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:07.793234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dea5a22b-06a2-48ea-b213-4472b23908d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1322 microversion: 2.1 time: 0.156273 Aug 30 16:18:07.793907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 83/164] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:07 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:07.881329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:07.882468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:07.889693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.890302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.890966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.891743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.892480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.892971 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.070976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.084187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-37198568-788b-4542-a4a5-fb4867c7a80a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.206759 Aug 30 16:18:08.089415 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 82/165] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:07 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:08.201233 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:08.201848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:08.209068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.209673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.210108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.210812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.211336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.211778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.350281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.359082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.360554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.361681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a70c2a5-fa65-4438-8a61-88f48d877939 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.170446 Aug 30 16:18:08.362348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 84/166] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:08 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:08.453261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:08.453875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:08.460175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.460659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.461095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.461795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.462254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.462674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.600850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.609118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0645c21e-5615-41a9-8fdb-9427918af473 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1502 microversion: 2.1 time: 0.159718 Aug 30 16:18:08.609740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 83/167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:08 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:08.814153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:08.814705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:08.820659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.821137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.821566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.822245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:08.822695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:08.823175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.015353 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.023590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6dd62efb-80d6-4ea8-a8f0-0b12a3b748a6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1515 microversion: 2.1 time: 0.213459 Aug 30 16:18:09.027328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 85/168] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:08 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:09.045763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:09.048096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:09.054105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.054593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.055042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.055804 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.056260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.056690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.112235 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:09.112856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:09.118504 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lazy-loading 'flavor' on Instance uuid 4aa19fe1-b789-43c1-8471-ee231a65cc92 {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:18:09.119488 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.120101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.120703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.121621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.122606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.123245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.254929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7c95164e-b3b3-403a-8cbc-1282083c1e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92/action" status: 200 len: 32 microversion: 2.1 time: 0.212271 Aug 30 16:18:09.256631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 84/169] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:18:09 2022] POST /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:18:09.266986 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:09.267900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:09.275190 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.275823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.276444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.277213 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.277898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.278417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.279943 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.289793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ceb55167-9e62-46f7-b775-bce0aa8fe1fa tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.181893 Aug 30 16:18:09.290666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 86/170] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:09 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:09.384251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:09.385014 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:09.391368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.391854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.392288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.392981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.393433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.393854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.423643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.431606 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-95f85963-80e2-48dc-aff4-bf33ba1ac1e2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.169705 Aug 30 16:18:09.432182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 85/171] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:09 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:09.527619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.535663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.537119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:09.538213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bcdeced4-8b6a-42f7-a264-653be5a56dc1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.157834 Aug 30 16:18:09.538774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 87/172] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:09 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:10.317628 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:10.318259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:10.325624 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.326273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.326716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.327460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.327921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.328356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.453291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:10.453899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:10.460501 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.460989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.461422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.462115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.462560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.462979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.482387 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:10.491924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:10.500598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f3fbeed2-8438-483a-b214-3890967064b0 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.191447 Aug 30 16:18:10.501179 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 86/173] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:10 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:10.562010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:10.562780 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:10.568634 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.569118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.569550 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.570254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:10.570707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:10.571142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.594983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:10.603033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98f7bd0b-43f1-485a-9505-216947ccb1b0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.154178 Aug 30 16:18:10.603702 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 88/174] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:10 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:10.709672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:10.718399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:10.719893 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:10.721031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b7684b58-f27b-49ac-9c14-c17b26330114 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.163661 Aug 30 16:18:10.721615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 87/175] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:10 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:11.522024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:11.522731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:11.529445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.529971 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.530405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.531105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.531597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.532022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.623782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:11.624976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:11.632309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.632691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.633223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.633835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.634286 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.634700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.675469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:11.684287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b9d5be4-201e-4968-9859-b3a233f3592b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.165727 Aug 30 16:18:11.684769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 89/176] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:11 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:11.744219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:11.744813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:11.751243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.751732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.752160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.752845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:11.753294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:11.753710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:11.781483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:11.789783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-27364c56-8248-421c-84fa-19a944a87e52 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.169668 Aug 30 16:18:11.790397 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:11 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:11.894366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:11.902533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:11.904664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:11.905768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-38697751-735a-4733-ba49-f268b104ebd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.165447 Aug 30 16:18:11.906333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 90/178] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:11 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:12.705269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.705836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:12.712178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.712661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.713100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.713797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.714254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.714678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.810287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.811030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:12.816920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.817404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.817836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.818532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.818993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.819435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.848078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:12.855769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e4647bd7-d673-48bb-bd67-9b849258a0f6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.154416 Aug 30 16:18:12.857109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 89/179] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:12.927007 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.927646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:12.933776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.934577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.934998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.935737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.936193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.936615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.953866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:12.963677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-409dac86-1c5c-4aa1-bb5d-fead113d605f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.157559 Aug 30 16:18:12.975723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 91/180] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:13.101347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:13.109471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:13.110911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:13.112038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a3f26424-2bb5-4632-b400-29ae3a1de89a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.188956 Aug 30 16:18:13.112608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 90/181] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:13.877197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:13.877803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:13.884235 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:13.884898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:13.885374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:13.886183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:13.886636 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:13.887212 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:13.985948 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:13.986639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:13.993016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:13.993626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:13.994115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:13.994907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:13.995454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:13.995874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.032201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:14.046386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6be177ec-2088-44d0-8fc8-8cd296d8c938 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.173180 Aug 30 16:18:14.047548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 92/182] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:13 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:14.134441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.135197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:14.139641 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:14.141502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.141993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.142416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.143112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.143598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.144013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.148132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-159d77e1-c6b3-426a-b0d2-996f470de6aa tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.166031 Aug 30 16:18:14.148723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 91/183] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:13 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:14.242911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "047768c8-1943-49ab-866e-02bc2ed90118"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:14.245421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:14.251911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.252463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.252900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.253775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.254234 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.254659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.288643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:14.298134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:14.299622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:14.300929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85ae8add-20b6-45ef-985f-24eab4617279 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.170436 Aug 30 16:18:14.301813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 93/184] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:14 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:14.894075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70cd69f5-b796-45fb-a89f-d7d39864d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "1a19abfd-980a-447d-a628-c8d4ce1e2dc0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:14.911733 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.912034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.912278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.981619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] Creating event network-vif-plugged:1a19abfd-980a-447d-a628-c8d4ce1e2dc0 for instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae on hv-cinder-85220 Aug 30 16:18:15.015922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-82ddc2c1-79c7-4330-b869-e16bbc4c670a req-40eb62f7-d7b9-4910-a210-870fa34360dd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125109 Aug 30 16:18:15.019776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 94/185] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:15.067124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.067872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:15.077605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.078111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.078562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.079302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.079766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.080212 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.377524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:15.388689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-437b2351-6d60-4acd-a61d-27b8825ed61d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.325891 Aug 30 16:18:15.389559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 95/186] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:15.396377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.397472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:15.405304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.406665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.407259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.408194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.408961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.409388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.422745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:15.439807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-19e55bd7-a0a4-46a7-a0ab-c179523e558b tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "POST /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.200672 Aug 30 16:18:15.445867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 92/187] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:18:14 2022] POST /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121/os-volume_attachments => generated 194 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:15.467450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.467450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:15.478760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.479271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.479712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.480425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.480912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.481879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.581123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:15.589038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bd1c040-ba61-4b67-85d1-21c42d0db7df tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.197901 Aug 30 16:18:15.589613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 96/188] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:15.624470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:15.635881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:15.637836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:15.639132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2e8ff468-13fb-41eb-bd17-763e584cffe9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.193785 Aug 30 16:18:15.639730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 93/189] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:16.414956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:16.415783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:16.424743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.424923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.425315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.426799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.426799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.429739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.578488 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:16.587189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4bd6d94-4dca-4f09-8327-1986321ee24d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.176133 Aug 30 16:18:16.587925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 97/190] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:16 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:16.612523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:16.613741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:16.620652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.621189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.622201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.623096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.624461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.624461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.662390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:16.662999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:16.669348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.669836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.670273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.670977 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:16.671459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:16.671887 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:16.775911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:16.785682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9fe5eb6f-6619-496f-9b20-2fa16dc93ae1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.178365 Aug 30 16:18:16.786510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:16 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:16.841805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:16.860300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:16.863973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:16.865148 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dde67d51-744b-4f37-8c32-09e4eab5c020 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1406 microversion: 2.20 time: 0.207088 Aug 30 16:18:16.865876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 98/192] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:16 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:17.610684 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:17.611565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:17.639447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.647437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.647999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.649998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.651875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.653942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.809800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:17.810694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:17.818169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.819418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.819814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.820695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.821330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.822330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.868349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:17.877487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-920fb6ba-079d-44fa-90de-6ba863d4afc5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.272967 Aug 30 16:18:17.878079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 95/193] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:17 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:17.891447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:17.891447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:17.895873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.896301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.896761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.897442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:17.897925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:17.898326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:17.971743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:17.980342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d784cdb2-1df7-41dc-8ddd-659211961e89 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.174609 Aug 30 16:18:17.982131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 99/194] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:17 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:18.069103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:18.080638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:18.082108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:18.083287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e55d1785-0459-455e-9e34-92a33d311fbb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1598 microversion: 2.20 time: 0.198730 Aug 30 16:18:18.083846 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 96/195] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:17 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:18.111050 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:18.111605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:18.131749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.132263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.140036 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.140976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.141455 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.141891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.274370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cc62aec-1359-4ea4-bac0-d09091d3bbd7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170376 Aug 30 16:18:18.274974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 100/196] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 30 16:18:18 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:18:18.902100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:18.904144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:18.915830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.917101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.917828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.919592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.920458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.921267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:19.002766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:19.003856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:19.014748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:19.015279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:19.015707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:19.016693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:19.017303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:19.017890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:19.233571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:19.256551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bc77d80f-1791-4b49-ab1c-8edb0496e0c8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.359514 Aug 30 16:18:19.257391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 97/197] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:18 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:19.658756 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:19.666973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2935f96a-2f86-4285-a433-423ca2c32912 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.669176 Aug 30 16:18:19.667607 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 101/198] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:18 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:20.037447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:20.049489 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.049944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.050563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.062246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] Creating event network-changed:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:18:20.076513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-41afa365-5e11-4347-bf95-bbc5c3f1b275 req-b443a5b3-e2cc-4013-a2ad-ea0d82a9f147 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Aug 30 16:18:20.077771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 98/199] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:20.276987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:20.277742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:20.284606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.285325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.285956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.286843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.287330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.287830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.430960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:20.442252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4282f558-2674-47e0-a7e8-598bbca3d0a7 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.169128 Aug 30 16:18:20.443154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 102/200] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:20 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:20.690596 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:20.691300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:20.697443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.697923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.698351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.699040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.699548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.700028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.834637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:20.843076 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1a735812-1a72-46b8-af28-ba1e9b10095f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.156566 Aug 30 16:18:20.843690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 99/201] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:20 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:21.463645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:21.464256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:21.470927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:21.471456 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:21.471920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:21.472620 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:21.473082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:21.473509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:21.607131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:21.614847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05575aa3-b4b8-4658-894f-877777502ebb tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.154973 Aug 30 16:18:21.615451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 103/202] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:21 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:21.865782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:21.866386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:21.873709 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:21.874193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:21.874624 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:21.875351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:21.876064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:21.876482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:22.012841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:22.020507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b92f9218-f179-44c0-87b0-d8f3a57982a2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.159184 Aug 30 16:18:22.021075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 100/203] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:21 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:22.636555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:22.637153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:22.643163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:22.643680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:22.644118 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:22.644813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:22.645284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:22.645689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:22.773116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:22.781328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78fe1d09-0a5d-4258-ab33-0eddf4006f17 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.148664 Aug 30 16:18:22.781923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 104/204] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:22 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:23.042028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:23.042649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:23.049086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:23.049598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:23.050036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:23.050729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:23.051287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:23.051639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:23.184526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:23.192222 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-11ccde5e-d915-42c1-992a-4eef4137b676 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.154068 Aug 30 16:18:23.192795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 101/205] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:23 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:23.803678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:23.804228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:23.810239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:23.810725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:23.811170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:23.811883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:23.812340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:23.812769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:23.944481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:23.952891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bef1881c-20bb-4808-8ba5-d611561176fe tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1364 microversion: 2.1 time: 0.153269 Aug 30 16:18:23.953594 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 105/206] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:23 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:24.213439 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:24.214114 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:24.221048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.221563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.222010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.222731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.223192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.223703 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.358133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:24.365777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-da8f5c6c-521f-4a1d-91d1-f2fcab243dae tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.156257 Aug 30 16:18:24.366629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 102/207] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:24 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:24.974120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:24.974725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:24.981750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.982366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.982857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.983697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.984253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.984766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.989227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:25.133358 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:25.142471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bfd5a7e-9a08-4d45-ba96-cd482c6dd78b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1551 microversion: 2.1 time: 0.172234 Aug 30 16:18:25.143043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 106/208] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:24 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:25.163985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:25.164474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:25.170308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:25.170794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:25.171245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:25.171943 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:25.172403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:25.172825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:25.253854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d161e130-0d71-44cb-a90c-8ea5c51261a5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093630 Aug 30 16:18:25.254487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 103/209] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:18:25 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:25.388890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:25.389705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:25.396528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:25.397110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:25.397635 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:25.398437 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:25.398960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:25.399493 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:25.541592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:25.553164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ced70d55-8e98-48e7-acda-6dcf26f80561 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.169143 Aug 30 16:18:25.571327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 107/210] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:25 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:26.579458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:26.579458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:26.582199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:26.582747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:26.583353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:26.584161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:26.584678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:26.585162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:26.867017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:26.878723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-60606d73-4645-4d61-b082-84431bf3a5a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.308310 Aug 30 16:18:26.879540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 104/211] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:26 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:27.222354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70cd69f5-b796-45fb-a89f-d7d39864d2ae", "tag": "1a19abfd-980a-447d-a628-c8d4ce1e2dc0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:27.246650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:27.247319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:27.247970 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:27.261632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] Creating event network-changed:1a19abfd-980a-447d-a628-c8d4ce1e2dc0 for instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae on hv-cinder-85220 Aug 30 16:18:27.266991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-223faa4a-8cee-4e7d-b598-9409c567b7ed req-8e78b37b-6231-43f9-839b-8913231fd9ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048687 Aug 30 16:18:27.267637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 108/212] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:27.900590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:27.901230 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:27.908496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:27.909200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:27.909790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:27.910640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:27.911208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:27.911802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:28.084408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:28.095546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-380c61c7-6665-4d2c-b85b-034fb385fe50 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.198611 Aug 30 16:18:28.096716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 105/213] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:27 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:29.118387 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:29.119089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:29.125290 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:29.126033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:29.126471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:29.127165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:29.127649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:29.128082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:29.278224 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:29.287694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d521e96b-ce4a-4511-b78b-bffc4a71f5cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.173337 Aug 30 16:18:29.302107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 109/214] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:29 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:30.310530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:30.311183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:30.317722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.318211 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.318681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.319427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.319887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.320316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.457868 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:30.466379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-77164b42-b740-4181-b9c3-db74d8d48c07 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.160684 Aug 30 16:18:30.467027 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 106/215] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:30 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:31.488150 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:31.488796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:31.494951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:31.495463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:31.495904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:31.496615 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:31.497108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:31.497559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:31.664184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:31.673336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-208b303e-a6da-46cb-9831-33fb87519393 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.189067 Aug 30 16:18:31.674757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 110/216] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:31 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:32.696405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.697037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:32.704112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:32.705037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:32.705467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:32.706214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:32.706652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:32.707262 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:32.937199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:32.953344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c2671c5c-13c0-4e39-9001-875a18c68eab tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.260512 Aug 30 16:18:32.958552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 107/217] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:33.990672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.992119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:33.998399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:33.999082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:33.999553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.000258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.000974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.001399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.094477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.095798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:34.103053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.103795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.104323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.105290 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.105970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.118770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.148198 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:18:34.204153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:34.242083 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ff0c26b8-00f8-4959-8090-c7a033543bd6 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 204 len: 0 microversion: 2.1 time: 0.151697 Aug 30 16:18:34.243283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 108/218] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:18:34 2022] DELETE /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:34.252511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.253223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:34.257024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:34.259254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.259759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.260199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.260900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.261529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.262160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.266370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4d35062-9f18-43be-8239-3857ed749870 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.286113 Aug 30 16:18:34.267273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 111/219] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:34.464525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:34.473246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-adb124ec-fbfa-4242-b821-6d0eb108aac0 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1554 microversion: 2.1 time: 0.225341 Aug 30 16:18:34.473837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 109/220] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:35.288539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:35.289849 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:35.296111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:35.296604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:35.297043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:35.297883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:35.298337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:35.298909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:35.463558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.471997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-972361f0-16f5-4518-a933-30d1c81c931a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.187586 Aug 30 16:18:35.479785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 112/221] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:35 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:35.494204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:35.494827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:35.502172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:35.502951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:35.503649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:35.504687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:35.505471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:35.506087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:35.673722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.685502 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-99b4d584-1154-4848-8e0e-c8cfcaeb530e tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1554 microversion: 2.1 time: 0.195476 Aug 30 16:18:35.686860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 110/222] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:35 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:36.494299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:36.495573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:36.502783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.503444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.504084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.505135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.505586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.506009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.659868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:36.668742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09448839-a746-4ff8-90a5-6656b72cee5a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.178119 Aug 30 16:18:36.669438 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 113/223] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:36 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:36.710675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:36.712230 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:36.719677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.720336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.720936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.722425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.725233 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.727367 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.927314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:36.937237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33abf59f-dde8-4116-b030-1cdc6a9cc007 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1554 microversion: 2.1 time: 0.234046 Aug 30 16:18:36.937812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 111/224] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:36 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:37.551623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503606c2-4601-45a5-b761-95d70e8bf121", "name": "network-vif-deleted", "tag": "b00674f6-5432-48ae-8387-63f22819df14"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:37.561256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=63 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:37.566109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.567256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.567784 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.581357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] Creating event network-vif-deleted:b00674f6-5432-48ae-8387-63f22819df14 for instance 503606c2-4601-45a5-b761-95d70e8bf121 on hv-cinder-85220 Aug 30 16:18:37.587034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2a28c119-a7f5-4fa0-a252-118b9afe3b5e req-b72bcb33-5fa4-464a-8f95-b20bb8341473 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Aug 30 16:18:37.588126 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 114/225] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:37.691098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:37.692711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:37.699562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:37.701474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.702874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.703546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.704496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.705143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.705783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.893183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:37.905271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2e6e3dde-ce20-446f-9f37-df213dd90737 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.218918 Aug 30 16:18:37.906337 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 112/226] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:37 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:37.959179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:37.961254 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:37.974248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.975877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.977709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.979441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.982364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.982978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:38.107728 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6d51cbceff489bae4222ff8888ac16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c148946e0fe4eadacb3cfcade050e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:38.117618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f03d45ab-8b0a-422a-914f-c3752cb09031 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 200 len: 1345 microversion: 2.1 time: 0.162397 Aug 30 16:18:38.131662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 115/227] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:37 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 1345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:38.927657 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:38.928448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:38.934443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.934942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.935520 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:38.936580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.937088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.937541 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.118359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:39.144795 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:39.145967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:39.158355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9b292f3b-b426-4936-b856-01d2811c4129 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.230754 Aug 30 16:18:39.159068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.160333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.160681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 113/228] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:38 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:39.161554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.162648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.163527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.164193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.181272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] HTTP exception thrown: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Request method failure captured: Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 HTTP/1.1 Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgO5_4hHz6YWmI8CJ-cukFwV0CR6rtjwy7HNH79FHm5ZDAhqHhFvMckp8ySz1nIUAQSLO0JyJyt8X-OQKo_q26fKcZed2js0Vah706TuO05UZrUXYSwwQ-rKWUTTGLHMv3UYmOwGdWjw1XIydVU3EepZhu-o-kT7WiLNf6WCziWJWU Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:18:39.186709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}] Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ca6d51cbceff489bae4222ff8888ac16 Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.188318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '503606c2-4601-45a5-b761-95d70e8bf121'} Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:39.189190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.190582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.192605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Returning 404 to user: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:39.193465 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70bbb084-106a-4111-93ba-8cfabc4d797a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 404 len: 111 microversion: 2.1 time: 0.055308 Aug 30 16:18:39.196852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 116/229] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:39 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:39.390806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:39.395110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:39.403238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.403742 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.404340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.405275 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.405810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.406273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.595883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] HTTP exception thrown: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Request method failure captured: Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121/os-volume_attachments HTTP/1.1 Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgO5_4hHz6YWmI8CJ-cukFwV0CR6rtjwy7HNH79FHm5ZDAhqHhFvMckp8ySz1nIUAQSLO0JyJyt8X-OQKo_q26fKcZed2js0Vah706TuO05UZrUXYSwwQ-rKWUTTGLHMv3UYmOwGdWjw1XIydVU3EepZhu-o-kT7WiLNf6WCziWJWU Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:18:39.600537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}] Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ca6d51cbceff489bae4222ff8888ac16 Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.601968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'server_id': '503606c2-4601-45a5-b761-95d70e8bf121'} Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:39.603037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:39.604300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:39.605951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Returning 404 to user: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:39.605951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-01bd29d1-c52a-4c95-8f6a-795aad6e0153 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.216340 Aug 30 16:18:39.605951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 114/230] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:18:39 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121/os-volume_attachments => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:40.182178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:40.182803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:40.188858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.189342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.189813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.190470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.190937 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.191405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.328067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:40.335644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a044c7ff-2bd9-4f28-b814-17201ec3c4c7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.157513 Aug 30 16:18:40.336206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 117/231] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:40 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:40.864547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:40.865764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:40.873764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.874674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.875351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.876523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.877203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.877835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.897449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] HTTP exception thrown: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Request method failure captured: Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 HTTP/1.1 Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgO5_4hHz6YWmI8CJ-cukFwV0CR6rtjwy7HNH79FHm5ZDAhqHhFvMckp8ySz1nIUAQSLO0JyJyt8X-OQKo_q26fKcZed2js0Vah706TuO05UZrUXYSwwQ-rKWUTTGLHMv3UYmOwGdWjw1XIydVU3EepZhu-o-kT7WiLNf6WCziWJWU Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:18:40.905389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}] Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ca6d51cbceff489bae4222ff8888ac16 Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.906549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '503606c2-4601-45a5-b761-95d70e8bf121'} Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:40.907308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.908373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.909462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Returning 404 to user: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:40.909462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d719af28-ea27-49d6-8b3e-bbaffc675e87 tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "DELETE /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 404 len: 111 microversion: 2.1 time: 0.041713 Aug 30 16:18:40.909462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 115/232] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:18:40 2022] DELETE /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:40.911361 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:40.912325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] [instance: 503606c2-4601-45a5-b761-95d70e8bf121] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:40.919013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.919532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.920159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.920867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.921322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.921749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.935415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] HTTP exception thrown: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Request method failure captured: Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 HTTP/1.1 Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgO5_4hHz6YWmI8CJ-cukFwV0CR6rtjwy7HNH79FHm5ZDAhqHhFvMckp8ySz1nIUAQSLO0JyJyt8X-OQKo_q26fKcZed2js0Vah706TuO05UZrUXYSwwQ-rKWUTTGLHMv3UYmOwGdWjw1XIydVU3EepZhu-o-kT7WiLNf6WCziWJWU Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:18:40.936938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6c148946e0fe4eadacb3cfcade050e5f"}]}] Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 6c148946e0fe4eadacb3cfcade050e5f Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-939475816 Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ca6d51cbceff489bae4222ff8888ac16 Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-939475816-project Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.939993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '503606c2-4601-45a5-b761-95d70e8bf121'} Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:40.940741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. Aug 30 16:18:40.941800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:18:40.944892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] Returning 404 to user: Instance 503606c2-4601-45a5-b761-95d70e8bf121 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:40.946264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37700e21-1412-455b-bd6a-b77059ea615a tempest-DeleteServersTestJSON-939475816 tempest-DeleteServersTestJSON-939475816-project] 10.222.0.57 "GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121" status: 404 len: 111 microversion: 2.1 time: 0.040077 Aug 30 16:18:40.947369 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 118/233] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:40 2022] GET /compute/v2.1/servers/503606c2-4601-45a5-b761-95d70e8bf121 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:41.360328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:41.362676 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:41.376590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.377092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.377526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.378250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.378708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.379138 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.625237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:41.637371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9c633eb9-4275-4596-8806-72e72d3e01ff tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.282135 Aug 30 16:18:41.638182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 116/234] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:41 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:42.658872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:42.659647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:42.675814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.677657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.678520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:42.685325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.686042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.690989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.024064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:43.034516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77b8c0db-6115-4503-9994-66d5ecc7cabc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.378610 Aug 30 16:18:43.035375 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 119/235] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:42 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:44.059712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:44.061188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:44.075097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:44.075920 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:44.076609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:44.078203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:44.078860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:44.079535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:44.469090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:44.478187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bfa0083d-c5b3-4722-b42a-88b9b7e4c40d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.425207 Aug 30 16:18:44.479044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 117/236] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:44 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:45.500585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:45.502228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:45.516630 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:45.520368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:45.521143 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:45.522539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:45.526688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:45.530161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:45.835118 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:45.847795 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f04a73e1-94d8-417b-9aef-7084b70a2846 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.350786 Aug 30 16:18:45.865367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 120/237] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:45 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:46.880206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:46.881374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:46.891649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.893065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.894362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.896743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.897625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.898452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:47.154674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.163685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8f515d6d-df2f-4764-b140-04a7928f0110 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.294693 Aug 30 16:18:47.164264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 118/238] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:46 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:48.193396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:48.194175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:48.206763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.207545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.208824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.210625 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.211494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.212529 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.451917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-807377467", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:48.507547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:48.525211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7364fba9-083d-4a3a-9a8a-c33813667964 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.342522 Aug 30 16:18:48.527145 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 121/239] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:48 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:48.565703 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] validate_networks() for None {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:18:49.019753 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:18:49.021105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:18:49.021731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:18:49.022414 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:18:49.024074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:18:49.036420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.037069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.037694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:49.038487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.039005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.039913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:49.075127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Getting quotas for project 280dfa8a14794440aeac6c75a1c9d471. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:18:49.096316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Getting quotas for user b62f9fe4e66e42e2b3d75bee462ec079 and project 280dfa8a14794440aeac6c75a1c9d471. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:18:49.116465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:18:49.119980 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:18:49.195546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bc6545b7-0975-4d92-9a1a-aba1a94f725f tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751626 Aug 30 16:18:49.196456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 119/240] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:18:49.208581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a8e24f9-b643-4a6b-ad3f-23868ee48fad tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:49.215865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a8e24f9-b643-4a6b-ad3f-23868ee48fad tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:49.341763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a8e24f9-b643-4a6b-ad3f-23868ee48fad tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:49.357957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a8e24f9-b643-4a6b-ad3f-23868ee48fad tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1214 microversion: 2.1 time: 0.153920 Aug 30 16:18:49.358541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 122/241] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:49 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:49.553000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:49.559312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:49.606321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.606949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.609192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:49.610944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.611907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.612620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.205426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.218042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-65f9f8ac-af1c-4def-a927-a71fc9646454 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.670393 Aug 30 16:18:50.218622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 120/242] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:49 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:50.384900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:50.385635 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:50.392718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.393500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.394009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.394957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.395656 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.396156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.484066 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.496615 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98e13e2e-9d5c-42ac-aa73-83394d5a2fd8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1266 microversion: 2.1 time: 0.116421 Aug 30 16:18:50.498054 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 123/243] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:50 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:51.246523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:51.246523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:51.266258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.267425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.268138 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.269802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.270671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.271507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.521701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:51.523277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:51.531599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.534519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.535889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.537855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.538881 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.540296 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.691853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:51.721859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53c19604-be85-4bbf-a99b-67a80da59a92 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1266 microversion: 2.1 time: 0.203267 Aug 30 16:18:51.722570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 124/244] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:51 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:51.764421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:51.773530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-cec41da4-b6f3-41dc-93ea-bc51a474cf88 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1521 microversion: 2.1 time: 0.538256 Aug 30 16:18:51.775833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 121/245] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:51 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:52.745484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:52.746624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:52.767377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.768197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.768649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.770652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.771127 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.771825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.802782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:52.804241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:52.826653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.829329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.829905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.830722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.831309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.831743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.951260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:52.962210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16d917f2-87a9-45fd-83e2-c2f17b421adb tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1272 microversion: 2.1 time: 0.221418 Aug 30 16:18:52.966675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 125/246] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:52 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.098467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:53.112138 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ab76f662-d3b7-4b7b-a13f-87d315bcf5ca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1501 microversion: 2.1 time: 0.314811 Aug 30 16:18:53.113251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 122/247] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:52 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.141503 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:53.142203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:53.150264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.150932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.151856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.152715 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.153400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.154040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.182319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:53.350931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:53.371874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fe43c87-7e0a-43a8-ace1-bd704f453ac8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1515 microversion: 2.1 time: 0.225624 Aug 30 16:18:53.372539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 126/248] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:53 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.996953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:53.998223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:54.030643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.031142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.060353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:54.061134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.061618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.062053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:54.354652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:54.396084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-68ceb9ab-bdf1-43da-b6ec-4cf8050f1afc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1272 microversion: 2.1 time: 0.406728 Aug 30 16:18:54.397405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 123/249] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:53 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:55.169392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:55.180053 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:55.188394 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.189317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.190085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.191139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.191778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.192621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.244271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lazy-loading 'flavor' on Instance uuid 7002e560-8234-4472-94da-e854fa3aa36c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:18:55.419863 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:55.420526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:55.425591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81f891bf-5dae-406f-b906-427b2ed7cdd1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/action" status: 200 len: 32 microversion: 2.1 time: 0.265458 Aug 30 16:18:55.431806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 127/250] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:18:55 2022] POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:18:55.434725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.438266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:55.439270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:55.444039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.444493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.445420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.445940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.446376 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.448253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.448965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.449578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.450526 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.451313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.451884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.862636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:55.883175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-575bb04c-edc7-4b02-80ca-3ad53e09ddbc tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.464012 Aug 30 16:18:55.884806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 124/251] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:55 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:56.112689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:56.127753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99b3e796-f041-4fc7-ba67-5b264b91a54a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.693247 Aug 30 16:18:56.129346 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 128/252] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:55 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:56.371063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3b0919-b94a-4e4b-b449-dbc6d46335f0", "tag": "3959eb9d-fd9a-47e4-a75d-e4961e38d81b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:56.406836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.407520 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.407962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.427085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] Creating event network-changed:3959eb9d-fd9a-47e4-a75d-e4961e38d81b for instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 on hv-cinder-85220 Aug 30 16:18:56.436538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-b3cb2860-5050-4f41-8fce-8954cfc632bf req-211a933e-ce68-4ed2-aca7-4319fefcaca6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074941 Aug 30 16:18:56.438172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 125/253] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:56.905701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:56.906898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:56.924429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.926730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.927923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.934720 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.935214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.935674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.152951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:57.154318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:57.169348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.169771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.170583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.171773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.172613 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.173220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.605240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.619764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-85e72171-f5fa-4cc2-b55a-29df62b2d41d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.473120 Aug 30 16:18:57.620773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 126/254] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:57 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:57.850356 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.862381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e873d010-2387-4956-9c51-2747b86eb773 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.960653 Aug 30 16:18:57.863260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 129/255] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:56 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:58.640615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:58.641832 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:58.660151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.661819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.662442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.663393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.664004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.664661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.885424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:58.886048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:58.894201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.894699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.895134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.910154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.910801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.915583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:59.008117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.026364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0c02382e-c713-47b5-ba6b-0615c6c5b1cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.389312 Aug 30 16:18:59.031404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 127/256] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:58 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:59.192899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.204009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-930e1264-18a9-4ee5-9f46-2c6b943fc55a tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.322124 Aug 30 16:18:59.219252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 130/257] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:58 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:00.057714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:00.058985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:00.061169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:00.062272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:00.071515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:00.072296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:00.072928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.073832 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:00.074428 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:00.075002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.099080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:00.229597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:00.231069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:00.249903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:00.261818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:00.263730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:00.265532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.267122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:00.269061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:00.269703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.468534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:00.493558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dabf244c-1522-4f87-ada8-aeae4ea7a146 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.268954 Aug 30 16:19:00.494156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 131/258] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:00 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:00.513640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:00.531583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-61d0a2fa-ec91-4994-9bce-8b7c48c56a78 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.480585 Aug 30 16:19:00.532840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 128/259] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:00 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:01.515270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:01.515911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:01.532687 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.534786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.535506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.536270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.536741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.537173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.561643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:01.562872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:01.573265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.575922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.581815 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.584095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.585702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.586270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.828467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:01.838527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f28b0ee9-ef67-40a4-9c90-298ac5916b11 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.327844 Aug 30 16:19:01.839129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 132/260] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:01 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:01.951589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:01.961500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4f828858-8c21-413f-8406-abc19564e7b4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.405292 Aug 30 16:19:01.963442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 129/261] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:01 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:02.666099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34d85374-72d1-4815-9e0d-2353e50f5e15 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Action: 'create', calling method: .version_select at 0x7f1266efeca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1440648328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/o9xMLAj2f4Oqa9NSijzwAchF6b04pxJnPsnEPe3pg11+hBZXPSpJ1uh06pPyRocjfpu/eMPYJpm8DNVpd2C5NS1Tfa42TNeKExtnb4vF5XZhbfwY0UiNI/ZYEOzDPhg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:02.682948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-34d85374-72d1-4815-9e0d-2353e50f5e15 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Getting quotas for project 43a1fa996402448091ef05ed5b8467af. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:02.687530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-34d85374-72d1-4815-9e0d-2353e50f5e15 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Getting quotas for user af14713dfbb348fa8824570570225de4 and project 43a1fa996402448091ef05ed5b8467af. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:02.710293 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34d85374-72d1-4815-9e0d-2353e50f5e15 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.220971 Aug 30 16:19:02.711070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 133/262] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:02.863067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:02.863716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:02.871985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.872538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.872977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.873720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.874384 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.874892 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.996627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:02.997596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:03.008972 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:03.009757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:03.010274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:03.011071 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:03.011775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:03.012209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:03.068775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.077691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7157f3ad-5909-452d-b95a-2c9a67b2e904 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.218695 Aug 30 16:19:03.077792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 130/263] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:02 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:03.234984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.244307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-378d4213-03cb-4c2a-877b-f7ee751686f2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.261520 Aug 30 16:19:03.247255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 134/264] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:02 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:03.843579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b0919-b94a-4e4b-b449-dbc6d46335f0", "name": "network-vif-plugged", "status": "completed", "tag": "3959eb9d-fd9a-47e4-a75d-e4961e38d81b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:03.857992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:03.859098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:03.860292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:03.878501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] Creating event network-vif-plugged:3959eb9d-fd9a-47e4-a75d-e4961e38d81b for instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 on hv-cinder-85220 Aug 30 16:19:03.894063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-93d3b4f1-93c9-486e-b5b2-7237b11d3fad req-34676c7b-c35e-4774-979c-bb57e9ab0e1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054914 Aug 30 16:19:03.895800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 131/265] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:04.099843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:04.100452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:04.107162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.107676 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.108266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.108966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.109574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.110067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.266688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:04.267516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:04.278930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:04.282926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.283455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.283899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.287561 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-abf9702c-8613-42d0-92b9-ec077cba29d8 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.191413 Aug 30 16:19:04.288058 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.288535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.288910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 135/266] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:04 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:04.289029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.445648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:04.453880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-169d2f03-6da0-4041-a58c-0c6a81343575 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.191628 Aug 30 16:19:04.455667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 132/267] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:04 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:05.309667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:05.310329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:05.316502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.316993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.317431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.318134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.318599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.319027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.476603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:05.477946 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:05.484786 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.485861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.486570 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.487819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.488398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.488932 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.491057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.503701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a13a7584-4622-476d-ab8f-e1a23e898cf2 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.198188 Aug 30 16:19:05.508604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 136/268] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:05 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:05.651963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.677835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b46ee4f0-7da5-483e-bf36-e12b1006d9b5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.205252 Aug 30 16:19:05.678731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 133/269] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:05 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:06.535170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.536967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.546479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.547659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.548542 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.549585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.550422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.551194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.708329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.709619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.717839 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.718411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.718861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.719608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.720072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.720506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.737574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.746243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77f1cc80-a473-4487-a0d2-98a01b8a85c3 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1314 microversion: 2.1 time: 0.217438 Aug 30 16:19:06.746852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 137/270] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:06 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:06.894093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.902211 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3d9acd8e-1f1b-4766-8856-e3222c6e60c0 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.201479 Aug 30 16:19:06.903253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 134/271] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:06 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:07.767356 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.768005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:07.770878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:07.775263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.776262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.776931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.777833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.778483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.779137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.924268 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.925031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:07.927717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:07.934382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.934912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.935380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.935794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:07.936098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.936554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.937178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.946286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f142c07-7144-4a98-ac7b-440eecc3b9a1 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1464 microversion: 2.1 time: 0.182783 Aug 30 16:19:07.946886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 138/272] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:07 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:08.002486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:08.008326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:08.015048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.015678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.016242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.016817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.017272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.017698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.046311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:19:08.150000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de14e208-fa1d-4b26-be47-15b3b7935194 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 204 len: 0 microversion: 2.1 time: 0.154099 Aug 30 16:19:08.150979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 139/273] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:07 2022] DELETE /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:08.156206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.165344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4c852292-4cee-4a32-a854-ef2760cfeb58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.245209 Aug 30 16:19:08.166616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 135/274] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:07 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:08.179523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:08.179523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:08.179523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.179523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.182389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.182389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.182389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.182389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.205227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:08.340186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.350981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d0ea403-9701-4402-9d55-30614dff9423 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1470 microversion: 2.1 time: 0.195380 Aug 30 16:19:08.352063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 140/275] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:08 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:09.197773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:09.198379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:09.205403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.205865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.206299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.206987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.207581 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.207889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.345226 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.352993 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f643f23a-ce3d-44d1-acbc-68ab08e8bc6f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.159156 Aug 30 16:19:09.353585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 136/276] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:09 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:09.378437 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:09.379067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:09.385808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.386300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.386736 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.387463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.387922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.388347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.521155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.529368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d43ea3f-965f-4d67-a10b-2911799dd202 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1470 microversion: 2.1 time: 0.155558 Aug 30 16:19:09.529947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 141/277] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:09 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:10.375640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:10.376317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:10.382189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.382620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.383053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.383978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.384407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.384836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.551605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:10.552561 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:10.559658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.560268 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.560705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.561428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.561880 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.562298 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.629546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.659070 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6c4e54df-be1b-4313-852e-7c83e8516310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.288857 Aug 30 16:19:10.659763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 137/278] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:10 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:10.711486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62f9fe4e66e42e2b3d75bee462ec079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280dfa8a14794440aeac6c75a1c9d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.724279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f50fb029-596b-410b-b35f-f0f1ffab0378 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 200 len: 1470 microversion: 2.1 time: 0.176707 Aug 30 16:19:10.725093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 142/279] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:10 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:10.837420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b0919-b94a-4e4b-b449-dbc6d46335f0", "name": "network-vif-deleted", "tag": "3959eb9d-fd9a-47e4-a75d-e4961e38d81b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:10.847967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.848446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.848886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.861593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] Creating event network-vif-deleted:3959eb9d-fd9a-47e4-a75d-e4961e38d81b for instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 on hv-cinder-85220 Aug 30 16:19:10.867939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-36fb9549-13ec-4c6b-9af0-3549bcefb308 req-a6c07136-583c-484e-8c09-5b520c957c6c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Aug 30 16:19:10.868540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 138/280] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:19:11.680215 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:11.681577 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:11.687577 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.688290 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.688727 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:11.689432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.689892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.690318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:11.747339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:11.748720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] [instance: 2f3b0919-b94a-4e4b-b449-dbc6d46335f0] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:11.757658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.758507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.760124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:11.761758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.763329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.764254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:11.796672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] HTTP exception thrown: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Request method failure captured: Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 HTTP/1.1 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjhlsjRoB4oZLDRejnXIxhnnAsCZ6GyEQ2bebJ-0lPbYQ7bSrkIwioSzcQRmQWYOAuAYbcwjc-nJ3JwAqUb_Ihn3o2U6J5XB_yIZ4dFAaV3Ex7YRK2_zwCKuhhb8Ree8RMAjcJv_o9AgT9C1Qo1kj8INK18HYZ0KtTwcUrGG4P-bT44 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 280dfa8a14794440aeac6c75a1c9d471 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesNegativeTest-1318645021 Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:19:11.798645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_280dfa8a14794440aeac6c75a1c9d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/280dfa8a14794440aeac6c75a1c9d471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/280dfa8a14794440aeac6c75a1c9d471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/280dfa8a14794440aeac6c75a1c9d471"}]}] Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesNegativeTest-1318645021 Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 280dfa8a14794440aeac6c75a1c9d471 Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesNegativeTest-1318645021 Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesNegativeTest-1318645021-project Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: b62f9fe4e66e42e2b3d75bee462ec079 Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesNegativeTest-1318645021-project Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. Aug 30 16:19:11.800201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '2f3b0919-b94a-4e4b-b449-dbc6d46335f0'} Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:11.801067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. Aug 30 16:19:11.802390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:19:11.805047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] Returning 404 to user: Instance 2f3b0919-b94a-4e4b-b449-dbc6d46335f0 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:11.806117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-85430cd2-8a4b-4128-a14d-d15b562aab42 tempest-VolumesNegativeTest-1318645021 tempest-VolumesNegativeTest-1318645021-project] 10.222.0.57 "GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0" status: 404 len: 111 microversion: 2.1 time: 0.064099 Aug 30 16:19:11.807211 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 139/281] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:11 2022] GET /compute/v2.1/servers/2f3b0919-b94a-4e4b-b449-dbc6d46335f0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:11.857185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:11.865710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56f90461-193d-4c37-bfef-bbadc3f4c2c9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.189097 Aug 30 16:19:11.880073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 143/282] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:11 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:12.888454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:12.889285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:12.895702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.896192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.896626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.898130 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.898588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.899016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:13.057406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:13.069869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a73b7b84-9100-491a-af54-e24382222549 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.185085 Aug 30 16:19:13.070801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 140/283] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:12 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:14.096872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:14.097500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:14.102783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:14.105722 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.106304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.106864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.107628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.108093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.108524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.260340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:14.268346 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c5216ad-20bb-486e-b024-296b5b620538 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.175286 Aug 30 16:19:14.268921 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 144/284] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:14 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:15.290664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:15.291283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:15.298852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:15.299370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:15.299946 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:15.300903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:15.301282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:15.301706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:15.454253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:15.471061 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-abc84524-f05f-44d3-8935-940296421b76 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.185447 Aug 30 16:19:15.471833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 141/285] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:15 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:16.493984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:16.494994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:16.504791 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.505534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.506221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.507362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.508088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.508748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.645870 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.654897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f316f499-6f3a-4374-a668-9630494d25a8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.166110 Aug 30 16:19:16.655730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 145/286] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:16 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:17.675538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:17.676157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:17.682605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.684004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.684450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.685157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.685738 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.686046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.828919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:17.836639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-380970f6-325f-468f-8bfa-03655e7c10d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1501 microversion: 2.1 time: 0.164870 Aug 30 16:19:17.837217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 142/287] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:17 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:17.857097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac3ba5d3-80aa-42b1-9bd1-f87368b5343c"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:17.859915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:17.866077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.866581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.867022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.867761 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.868225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.868657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] HTTP exception thrown: Cannot 'attach_volume' instance 7002e560-8234-4472-94da-e854fa3aa36c while it is in vm_state rescued Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Request method failure captured: Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/os-volume_attachments HTTP/1.1 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 74 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgT2xKprBMSu4MTqd9iOyiwhwW0Gm7-LBOAW5vKR3yfLujjpJH-57IXRTpkINxVTEp7zVacc40uGiS6k3Mqd18Wg9VmpDUprnTYADlu4Z2LZlENE9UL1_Tcoru1jwOmOhFrvlDxwPd0W0iNirFw1eLHjC80X6tKouYTnAr4C8hHO5Q Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:19:17.898167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dff1326e1026492080d292aa3a157366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dff1326e1026492080d292aa3a157366"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}] Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 03eed7086183469f8cc1e765422bea87 Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "ac3ba5d3-80aa-42b1-9bd1-f87368b5343c"}} Aug 30 16:19:17.899593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Cannot 'attach_volume' instance 7002e560-8234-4472-94da-e854fa3aa36c while it is in vm_state rescued Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'server_id': '7002e560-8234-4472-94da-e854fa3aa36c', 'body': {'volumeAttachment': {'volumeId': 'ac3ba5d3-80aa-42b1-9bd1-f87368b5343c'}}} Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7002e560-8234-4472-94da-e854fa3aa36c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:17.900350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7002e560-8234-4472-94da-e854fa3aa36c while it is in vm_state rescued Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:17.901553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7002e560-8234-4472-94da-e854fa3aa36c while it is in vm_state rescued Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Returning 409 to user: Cannot 'attach_volume' instance 7002e560-8234-4472-94da-e854fa3aa36c while it is in vm_state rescued {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84459591-f8b4-4ee1-8cb7-b67d99ad6e0c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045447 Aug 30 16:19:17.903289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 146/288] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:19:17 2022] POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:19:17.911578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:17.912262 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:17.921896 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.922685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.923482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.924769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.925397 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.925671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.995891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2f4ddba3-a34a-498b-b211-2f94f5b71ba6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/action" status: 202 len: 0 microversion: 2.1 time: 0.088241 Aug 30 16:19:17.999612 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 143/289] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:19:17 2022] POST /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:19:18.006678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:18.007173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:18.013994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:18.014572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:18.015250 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:18.016113 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:18.016788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:18.017335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:18.154415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.162363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94c23c44-aed4-401f-98a7-446f9ca57954 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.159894 Aug 30 16:19:18.186271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 147/290] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:18 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:19.194966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:19.195714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:19.202289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.203144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.204517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.205741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.206450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.206988 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.382258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:19.391191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-88de02c7-e0a4-46ef-a9b6-b9a5381fe08a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.200917 Aug 30 16:19:19.405425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 144/291] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:19 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:20.412886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:20.413499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:20.420850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.421472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.422048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.422973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.423661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.424095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.624475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:20.633145 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9182e93d-8cf4-4f12-93d0-b30961362b14 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.224091 Aug 30 16:19:20.633808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 148/292] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:20 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:21.663484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:21.664105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:21.673648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.674162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.674606 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.675361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.675823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.676250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.892342 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:21.896388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:21.902137 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-90747d57-59bb-4550-875f-a84e36e13873 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.243451 Aug 30 16:19:21.903215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 145/293] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:21 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:22.925586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:22.926308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:22.935805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.936369 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.936920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.937652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.938172 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.938650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.094762 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:23.108480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5709947b-6049-483f-b505-bc6dfc52f848 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.188131 Aug 30 16:19:23.109273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 149/294] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:22 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:24.133983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:24.134620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:24.148403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:24.152454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:24.153154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:24.154098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:24.155596 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:24.156266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:24.406879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:24.418187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-413c4510-20f4-48ce-b627-8821c3d82a6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.291974 Aug 30 16:19:24.419537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 146/295] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:24 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:25.441699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:25.442315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:25.449493 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.449986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.450924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:25.451648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.452854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.453464 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:25.690044 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:25.700998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e7095c3-eff8-47d2-b2cf-f12de926b862 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.264609 Aug 30 16:19:25.716087 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 150/296] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:25 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:26.724820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:26.726780 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:26.738336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:26.739329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:26.740296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.741301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:26.742403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:26.743602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.992767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:27.004382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-105b5337-f5d3-4c4b-8210-41dbcec404a9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.285959 Aug 30 16:19:27.005517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 147/297] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:26 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:28.025981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:28.027267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:28.033704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.034454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.035074 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.036154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.036785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.037424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.192382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:28.200659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0983cc33-a53e-49e0-8854-c729f9f5617b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.178172 Aug 30 16:19:28.200942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 151/298] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:28 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:29.221696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:29.223089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:29.230712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:29.231872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:29.232305 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:29.233197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:29.233654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:29.234081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:29.441319 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.450350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-97c16e97-f6a5-4497-8cc8-661df1a0cf8d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.232480 Aug 30 16:19:29.451761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 148/299] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:29 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:30.472411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.473225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:30.480761 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.481396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.481978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.482798 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.483382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.483908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.664178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:30.675979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a3a10e8-71e5-4347-a0f2-22f89d6f643d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.205129 Aug 30 16:19:30.681243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 152/300] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:30 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:31.698143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:31.698765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:31.708040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.708540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.708979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.709695 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.710160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.710586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.971351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:31.982615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a77ce7e3-147a-4523-8193-f250721abbde tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.288490 Aug 30 16:19:31.983987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 149/301] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:31 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:33.004946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:33.006219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:33.012471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.012955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.013568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.014456 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.015062 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.015685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.196161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:33.205677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6720420d-27d3-4ec4-a772-58adf31be029 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.205217 Aug 30 16:19:33.212306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 153/302] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:32 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:34.240126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:34.240868 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:34.250919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.253259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.253779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:34.254568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.255283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.255775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:34.443179 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:34.451947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ecd4eec9-94af-4db9-9ec7-906968591d58 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.216139 Aug 30 16:19:34.454989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 150/303] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:34 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:35.476482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:35.477748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:35.489579 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:35.490374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:35.491053 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:35.492024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:35.492838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:35.493492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:35.641095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:35.654293 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d5d463a-d11e-456f-b6a7-68c0aec297b6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.181665 Aug 30 16:19:35.654994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 154/304] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:35 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:36.676454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:36.677068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:36.684843 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.685618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.686241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.686980 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.687477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.687912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.828113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:36.836587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-20c88af3-dee4-482d-a101-f19af177d49e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1509 microversion: 2.1 time: 0.164064 Aug 30 16:19:36.837169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 151/305] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:36 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:37.858160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:37.858816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:37.864984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:37.866388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:37.867076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:37.867846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:37.868579 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:37.869057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:37.869482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:38.046506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:38.054800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18cf482c-7d15-43ab-ab7c-a15db631fb87 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1515 microversion: 2.1 time: 0.201225 Aug 30 16:19:38.068180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 155/306] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:37 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:38.819385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c1f570f2-4b73-4cab-a880-13c5362b14d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'create', calling method: .version_select at 0x7f1266f73a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-620780505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAv/ahKgkrFHyJh2b5+NuLGqgMgNire5R63zqq91aK4R5Jt20OPOCIt+zOiKB9zzM1Ue1b7NPx8udzKhTC5Jk0oLyzsOsBXGPfIaLESLyiF4BDMGviOwcX8+OIB7aPY7Mw=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:38.824967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=34 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:38.835890 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-c1f570f2-4b73-4cab-a880-13c5362b14d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Getting quotas for project 568821f418bb465193aac9ec311b59b2. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:38.839691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-c1f570f2-4b73-4cab-a880-13c5362b14d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Getting quotas for user c7e2f2b39c84479aa194cfed89d8376b and project 568821f418bb465193aac9ec311b59b2. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:38.861547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c1f570f2-4b73-4cab-a880-13c5362b14d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045770 Aug 30 16:19:38.862152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 152/307] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:38.914325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-885187896", "imageRef": "b0665639-f3fd-482a-a2b0-0f48cb0c9d14", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-620780505", "networks": [{"uuid": "592bb008-6e55-4379-bedf-fd26ea5fb35b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:38.966421 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] validate_networks() for [('592bb008-6e55-4379-bedf-fd26ea5fb35b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:39.369494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:39.370474 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:39.370952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:39.371405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:39.371820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:39.382725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:39.383215 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:39.383685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:39.384461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:39.384918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:39.385539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:39.391163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=91 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:39.404073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Getting quotas for project 568821f418bb465193aac9ec311b59b2. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:39.408007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Getting quotas for user c7e2f2b39c84479aa194cfed89d8376b and project 568821f418bb465193aac9ec311b59b2. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:39.419164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:39.421442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0665639-f3fd-482a-a2b0-0f48cb0c9d14',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:39.471700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76dd37a5-2706-4a1d-8466-e5b41ba8436a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562111 Aug 30 16:19:39.476121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 156/308] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:39.484489 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-76c2260a-b22d-4a94-8c62-170a22b5c0cc tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:39.485117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-76c2260a-b22d-4a94-8c62-170a22b5c0cc tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:39.538595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-76c2260a-b22d-4a94-8c62-170a22b5c0cc tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:39.546718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-76c2260a-b22d-4a94-8c62-170a22b5c0cc tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1257 microversion: 2.1 time: 0.066326 Aug 30 16:19:39.547305 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 153/309] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:39 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:40.551078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89bc0b9d-4c83-4554-a5f4-42836fb5950d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: .version_select at 0x7f1266e074c0>, body: {"keypair": {"name": "tempest-keypair-1122095888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiEsWHnWOLqMWVI0QFtRWpZ+bTlXt7vWDFYIwNOMqXBPe1Nz94P0Wore/va1bFdTYRcevfAWgiuCTkn/ooH8ZHb+jUFqaOBU2AIi5SKUiLwu8sOCCEvn4TC7cT9W1ovUA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:40.566681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-89bc0b9d-4c83-4554-a5f4-42836fb5950d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for project dff1326e1026492080d292aa3a157366. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:40.568165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:40.568774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:40.570929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-89bc0b9d-4c83-4554-a5f4-42836fb5950d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for user 03eed7086183469f8cc1e765422bea87 and project dff1326e1026492080d292aa3a157366. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:40.575735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.576227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.576657 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.577345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.577798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.578219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.594240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89bc0b9d-4c83-4554-a5f4-42836fb5950d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047510 Aug 30 16:19:40.594845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 157/310] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:40.877562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:40.887065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3620b4cb-5f70-4065-b863-8b9feb25e244 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1309 microversion: 2.1 time: 0.322551 Aug 30 16:19:40.888084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 154/311] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:40 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:41.909130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:41.909863 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:41.933717 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:41.934219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:41.934682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:41.935421 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:41.935886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:41.936322 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.225264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:42.238152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf897682-1d39-49e7-a8ad-30697a8a6be5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.332750 Aug 30 16:19:42.238757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 158/312] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:41 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:42.842757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1892828489", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5497bee0-c4eb-4a90-ba93-1b1cfe8484bb"}], "security_groups": [{"name": "tempest-securitygroup--651184468"}], "key_name": "tempest-keypair-1122095888", "user_data": "}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:42.944833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] validate_networks() for [('5497bee0-c4eb-4a90-ba93-1b1cfe8484bb', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:43.259314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:43.259936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:43.266497 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.266991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.267463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.268164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.268625 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.269054 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.328622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:43.329085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:43.329600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:43.330051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:43.330572 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:43.340669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.341155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.341616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.342435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.342895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.343393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.363030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:43.367239 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Getting quotas for user 03eed7086183469f8cc1e765422bea87 and project dff1326e1026492080d292aa3a157366. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:43.381918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:43.384879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:43.410180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:43.420580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c91b5a2-6b54-4039-b609-e391c5d4be40 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.163844 Aug 30 16:19:43.421500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 159/313] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:43 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:43.437957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d2e133c3-fab2-474a-8c55-573ec99784e1 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.600247 Aug 30 16:19:43.438166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 155/314] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:43.449259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe1d531d-5a97-44fe-91d9-0ec31cdf633e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:43.449866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe1d531d-5a97-44fe-91d9-0ec31cdf633e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:43.516101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe1d531d-5a97-44fe-91d9-0ec31cdf633e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:43.523306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe1d531d-5a97-44fe-91d9-0ec31cdf633e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1246 microversion: 2.1 time: 0.078247 Aug 30 16:19:43.524067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 160/315] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:43 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:44.443853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:44.445450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:44.453340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.453973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.454507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.455504 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.456033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.456691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.545121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:44.545953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:44.552214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.553313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.553755 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.554454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.557914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.558454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.669683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:44.671670 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:44.681669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5cde193c-a3f2-4369-ba17-6d619a3977f2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.242406 Aug 30 16:19:44.689336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b677d78a-fa94-48a4-b071-fcbff609a8cb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.147224 Aug 30 16:19:44.698021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 156/316] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:44 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:44.699621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 161/317] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:44 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:45.710000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:45.711776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:45.712281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:45.716169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:45.724578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.726431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.727170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.727902 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.728642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.729644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.730254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.730959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.731619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.732058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.735332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.735772 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.828431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:45.836623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92970183-ad43-4dbb-b211-b6402099fd38 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.130485 Aug 30 16:19:45.837197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 162/318] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:45 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:45.915737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:45.923801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c52443c6-6aae-4723-a03c-7263cc01f6e1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.222477 Aug 30 16:19:45.932973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 157/319] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:45 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:46.858812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:46.860140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:46.866593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.867415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.867860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.868571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.869037 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.870032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.946161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:46.946918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:46.955060 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.955860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.956666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.957774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.958423 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.959314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:47.084371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:47.098509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cef4c3e-3761-4bbe-ac85-23b282283073 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.243674 Aug 30 16:19:47.099862 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 163/320] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:46 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:47.116970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:47.125541 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3b945d9d-c416-4bf3-b71c-6711c92f2387 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.183780 Aug 30 16:19:47.127123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 158/321] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:46 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:48.120505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.121124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.127331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.127822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.128264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.128956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.129416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.129846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.147937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.148714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.155686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.156181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.156616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.157307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.157761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.158185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.190667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:48.198364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cac31fa-db05-4fff-9f6f-11d60d79948f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.081645 Aug 30 16:19:48.198934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 164/322] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:48.289529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:48.297965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-cadadc06-740b-41d1-a9ca-65a4d9f1d4e2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.153861 Aug 30 16:19:48.298530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 159/323] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:49.218044 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:49.218681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:49.224696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.225297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.225608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.226305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.226753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.227208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.289094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:49.297016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab3665cd-23d1-42f6-aa13-04d98ca29310 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.082941 Aug 30 16:19:49.297571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 165/324] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:49 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:49.317774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:49.318395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:49.324858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.325344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.325786 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.326486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.326974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.327441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.453832 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:49.461445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-eaa10ea8-146b-4f48-937a-501446784c3b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.147535 Aug 30 16:19:49.462000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 160/325] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:49 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:50.318983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:50.320402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:50.324248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:50.328658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.329160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.329599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.330311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.330770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.331199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.398078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:50.406080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d432a6b-65b0-4fe2-91b5-6b3097fa5eed tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.091630 Aug 30 16:19:50.406854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 166/326] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:50 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:50.482169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:50.482717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:50.489544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.490046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.490485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.491202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.492313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.492965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.644740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:50.655197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c4297aa3-b1e2-47d1-ab71-adb69cb91609 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.176698 Aug 30 16:19:50.655825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 161/327] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:50 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:51.426810 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:51.427567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:51.433692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.434189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.434623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.435347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.435809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.436236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.503070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:51.512156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-361e16cc-c36f-45b3-b2dd-481923a3b845 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.089134 Aug 30 16:19:51.512966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 167/328] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:51 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:51.678174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:51.678780 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:51.686016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.686496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.686922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.687640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.688091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.688506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.826146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:51.837583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a6aca10f-8e17-49ee-a696-878417f51b67 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.163078 Aug 30 16:19:51.838909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 162/329] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:51 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:52.532797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:52.533409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:52.539469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.539894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.540328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.541022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.541505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.541975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.615935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:52.624285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e545c95b-164e-4e2e-83c4-e7b969ddf133 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.095331 Aug 30 16:19:52.624862 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 168/330] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:52 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:52.864621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:52.865422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:52.872830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.878618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.878962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.880256 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.880739 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.881174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.024659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:53.032454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-047ec4a7-a11c-48d4-9297-0c4daea02a2c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.177840 Aug 30 16:19:53.033017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 163/331] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:52 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:53.664813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:53.665865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:53.671836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:53.678654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.679305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.679861 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.680832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.681394 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.681927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.745518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:53.754431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-38e6af1a-531f-4dcc-8738-cf4023c5228d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.101425 Aug 30 16:19:53.761359 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 169/332] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:53 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:54.056406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:54.057252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:54.059177 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:54.059944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=12 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:54.066246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.066733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.067197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.067920 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.068372 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.068790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.210912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:54.213721 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=97 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:54.220425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3ab8f965-af07-48cb-8ba8-2c40de368ab2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.168808 Aug 30 16:19:54.221037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 164/333] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:54 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:54.777106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:54.777962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:54.783976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.784479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.784924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.785638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.786096 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.786518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.852502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:54.860203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cee2b39-13ef-4756-b5a0-d2b3e05ca131 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.087260 Aug 30 16:19:54.860769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 170/334] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:54 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:55.241700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:55.242309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:55.249300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.249783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.250217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.250908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.251398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.252077 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.390841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:55.398762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e5fb07fd-f657-46d8-beba-e770bf2bda11 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.160908 Aug 30 16:19:55.399479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 165/335] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:55 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:55.881645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:55.882250 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:55.888797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.889276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.889709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.890402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.890853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.891294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.951312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:55.958867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fff6c7e4-d9c2-430a-8de0-a30b6876e666 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.081183 Aug 30 16:19:55.959458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 171/336] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:55 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:56.419837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:56.420446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:56.426886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.427412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.428395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:56.429090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.429549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.429967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:56.600459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:56.612673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e1d5c532-ebf5-4f0f-815d-9f3a3adc65a0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.196285 Aug 30 16:19:56.613456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 166/337] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:56 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:56.981693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:56.982419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:56.988988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.989549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.990038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:56.990882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.991443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.991945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.058377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:57.066382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fd34ca4-aa8a-4162-b5be-54b5af18cd13 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1250 microversion: 2.1 time: 0.089600 Aug 30 16:19:57.066951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 172/338] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:56 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:57.636936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:57.638359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:57.649777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.650984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.651466 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.652203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.652663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.653090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.799853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:57.809639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ae4a29be-4ff7-4ebc-a718-54bb0d6be1aa tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.178230 Aug 30 16:19:57.810857 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 167/339] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:57 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:57.845754 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:57.865837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.866321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.866746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.881393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] Creating event network-changed:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:19:57.887370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8c720680-961b-4cea-b4e6-73e84d0fa4e8 req-d05d9ef5-566e-4e35-b328-7d75fb9d1da2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047627 Aug 30 16:19:57.888592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 173/340] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:58.086952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:58.087700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:58.097153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.097729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.098280 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.099442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.099901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.100501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.192490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:58.201260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3acc53ad-7a8f-4a2b-b29d-0ea65c57ea9f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1316 microversion: 2.1 time: 0.118288 Aug 30 16:19:58.202032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 168/341] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:58 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:58.831476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:58.832251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:58.839523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.840093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.840592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.841524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.842050 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.842546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.130704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:59.143140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e19903c-5aca-4325-8ccb-666753c86ebd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.316455 Aug 30 16:19:59.155331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 174/342] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:58 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:59.225621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:59.226296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:59.233022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.233516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.233965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.234666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.235381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.235635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.460284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:59.474076 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b1f547f1-7f3c-431d-b297-1dc1c945a40e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.251795 Aug 30 16:19:59.481509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 169/343] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:59 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:59.833429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:59.846895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.847930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.848521 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.860744 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] Creating event network-changed:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:19:59.879023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-37f1cab1-cc59-4713-b806-da7aa466ef1c req-6c5fd7b6-25fe-48bb-b687-d8465aa9a16c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050346 Aug 30 16:19:59.879628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 175/344] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:00.167775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:00.168284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:00.175128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.175645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.176080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.182907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.182907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.182907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.314829 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:00.323114 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ba7da0e9-15b9-4aac-b6dc-c56165a4db98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.160322 Aug 30 16:20:00.323709 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 170/345] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:00 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:00.497450 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:00.498152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:00.505432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.505953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.506384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.507357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.507822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.508242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.651594 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:00.653900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:00.660833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-704ddd0f-e800-4867-b55d-1817bf595f19 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.167578 Aug 30 16:20:00.661414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 176/346] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:00 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:01.343800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:01.344470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:01.350830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.351351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.351788 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.352476 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.352927 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.353370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.485915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:01.494390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b18797a5-fa66-4a1a-8f50-b2bdbea3ca97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.153944 Aug 30 16:20:01.494979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 171/347] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:01 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:01.682541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:01.683185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:01.689703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.690473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.690913 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.691650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.692117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.692541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.827029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:01.834690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f67ad1f-cdb6-4e84-b6f0-c7d2d261eb49 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.156720 Aug 30 16:20:01.835273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 177/348] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:01 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:02.517292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:02.518720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:02.526425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.527080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.527555 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.529171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.529656 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.530080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.570688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-633071349", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1440648328", "security_groups": [{"name": "tempest-secgroup-smoke-883638825"}], "networks": [{"uuid": "6a184f29-9517-419b-bc0c-6dd87299cbb1"}], "block_device_mapping_v2": [{"uuid": "917d93b5-09f2-42ce-9ccb-b2d5fdc5a41a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:02.711992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:02.715652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] validate_networks() for [('6a184f29-9517-419b-bc0c-6dd87299cbb1', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:02.721667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f876c1df-a9c6-481d-8f23-24e9d6920469 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.210649 Aug 30 16:20:02.722345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 172/349] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:02 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:02.855289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:02.855963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:02.863113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.863640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.864080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.864799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.866742 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.868642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.057621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:03.066496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bc059219-6821-4d5b-a115-8a0ee7c0f38d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.215471 Aug 30 16:20:03.067273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 173/350] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:02 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:03.137406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:20:03.137836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:20:03.138349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:20:03.138767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:20:03.139213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:20:03.147956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.148444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.148920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.149659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.150195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.150549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.168916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Getting quotas for project 43a1fa996402448091ef05ed5b8467af. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:20:03.173036 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Getting quotas for user af14713dfbb348fa8824570570225de4 and project 43a1fa996402448091ef05ed5b8467af. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:20:03.232573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:20:03.234965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='917d93b5-09f2-42ce-9ccb-b2d5fdc5a41a',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:20:03.411110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc841f42-7bd5-4861-8f73-5aa1174821ac tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.849663 Aug 30 16:20:03.411939 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 178/351] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:20:03.423756 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8d49ebbe-1d46-4d5c-9102-992f6b2fa7d8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:03.424378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8d49ebbe-1d46-4d5c-9102-992f6b2fa7d8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:03.480528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8d49ebbe-1d46-4d5c-9102-992f6b2fa7d8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:03.487895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8d49ebbe-1d46-4d5c-9102-992f6b2fa7d8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1088 microversion: 2.1 time: 0.068232 Aug 30 16:20:03.488512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 174/352] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:03 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:03.744494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:03.745364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:03.753314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.753864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.754300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.755187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.755789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.756221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.908963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:03.917210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b5b878d-ea16-46bf-acaa-0430d9628e85 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.177019 Aug 30 16:20:03.917520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 179/353] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:03 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:04.087037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:04.087726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:04.095258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.095795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.096233 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.096947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.097407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.097836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.276440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:04.287747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ee6805c9-6174-4a1f-b072-16327b7c8c0f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.204585 Aug 30 16:20:04.289117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 175/354] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:04 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:04.510339 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:04.511101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:04.517420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.517908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.518350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.519833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.520295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.520722 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.586751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:04.595820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d253826-82d1-4dcf-b292-7d9cf3492e03 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1138 microversion: 2.1 time: 0.089955 Aug 30 16:20:04.596413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 180/355] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:04 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:04.938417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:04.939029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:04.945264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.945750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.946188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.946885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.947378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.947814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.079019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:05.086687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a9af2293-876d-4949-9e2b-3f8a39a1f295 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.152127 Aug 30 16:20:05.087285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 176/356] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:04 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:05.310019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:05.310567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:05.316505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.316977 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.317420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.318109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.318565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.318990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.450125 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:05.457828 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b28ab23-73bb-449f-bed4-716dd56040c4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.152218 Aug 30 16:20:05.458393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 181/357] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:05 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:05.617477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:05.618007 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:05.625254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.625777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.626217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.627229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.627711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.628148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.690199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:05.697754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e7cace88-bb1e-4113-9459-806ce03c3af9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1138 microversion: 2.1 time: 0.084521 Aug 30 16:20:05.698395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 177/358] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:05 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:06.165093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.165710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.172296 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.172785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.173223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.173913 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.174369 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.174794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.303574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:06.311382 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-848655ae-bb6e-4449-8e6b-f10736a1780f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.150113 Aug 30 16:20:06.311969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 182/359] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:06.478330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.478931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.484967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.485455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.485891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.486586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.487046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.487508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.619421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:06.627996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-12332baa-9722-40e4-9282-aea0e6339ad9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.153457 Aug 30 16:20:06.628578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 178/360] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:06.718184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.718804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.722560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:06.728033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.728844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.729283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.730254 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.730616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.731047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.795879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:06.806525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a1777cb-3af1-4de5-9f54-e77f044878d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1138 microversion: 2.1 time: 0.092147 Aug 30 16:20:06.807253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 183/361] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:07.332848 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:07.333477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:07.339972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.340572 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.341000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.341712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.342196 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.342622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.525973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:07.534162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a14b7816-b4d9-4a35-9bc0-ad4eb76176de tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.205320 Aug 30 16:20:07.534833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 179/362] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:07 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:07.648262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:07.650015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:07.656614 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.657144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.658099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.658827 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.659326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.659846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.828271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:07.828885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:07.836236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.836626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.837061 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.837762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.838208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.838627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.886675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:07.897816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bdd26b4-8ac3-4c3a-a285-88c2811b1389 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.253472 Aug 30 16:20:07.899273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 184/363] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:07 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:07.910622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:07.919801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b4c33b3a-1dd0-478e-bc0f-2f23482e70f8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1204 microversion: 2.1 time: 0.095196 Aug 30 16:20:07.920924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 180/364] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:07 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:08.556140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:08.557010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:08.567174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.567903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.568521 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.569257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.569932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.570560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.732704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:08.740548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27d9f248-9faa-46e1-b058-07e6a3893b6c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.188638 Aug 30 16:20:08.741125 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 185/365] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:08 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:08.920797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:08.921432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:08.923947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:08.929617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.930169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.930611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.931401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.931913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.932342 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.941086 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:08.941701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:08.947799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.948283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.949361 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.950050 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.950502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.950922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.072818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:09.081064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5ababba3-1484-4ad5-b2c6-6aa087c9dce9 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.164314 Aug 30 16:20:09.081619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 181/366] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:08 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:09.083392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:09.091408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-69abb4de-e0ec-47cb-a1d4-a7c0c01bea66 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.154109 Aug 30 16:20:09.091976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 186/367] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:08 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:09.762147 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:09.762672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:09.768948 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.769422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.769862 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.770564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.771024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.771534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.786314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:09.902692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:09.912917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-01b80bce-fd9a-485e-abcb-b35cc52c8c87 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.155226 Aug 30 16:20:09.913503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 182/368] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:09 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:10.101547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:10.102064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:10.108182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.108679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.109112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.109813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.110262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.110680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.112464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:10.113080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:10.119676 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.120166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.120602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.121335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.121797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.122216 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.245292 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:10.253196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8fd23c87-40e7-4d48-b359-88200441a144 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.155486 Aug 30 16:20:10.253780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 187/369] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:10 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:10.266905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:10.274647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9277cc8c-c4f8-43be-a8d5-2cc44a3250e9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.166154 Aug 30 16:20:10.275211 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 183/370] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:10 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:10.934124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:10.934812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:10.940897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.941376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.941809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.942504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.942954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.943407 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.075267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:11.083240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11ef65f6-a351-4d72-8c79-a6b5d5f26fb6 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.153543 Aug 30 16:20:11.083835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 188/371] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:10 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:11.274250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:11.274795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:11.282032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.282524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.282962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.283701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.284166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.284598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.296941 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:11.297756 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:11.304072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.304718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.305006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.305926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.306513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.306946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.419113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:11.426853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b345f784-9da2-40a8-a50f-9055cd1cb046 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.156546 Aug 30 16:20:11.427472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 184/372] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:11 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:11.439153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:11.446996 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e06a386-6b7e-498e-a3f6-dbe67b5390c1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.154795 Aug 30 16:20:11.447634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 189/373] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:11 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:12.104468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:12.105094 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:12.111619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.112106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.112537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.113259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.113713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.114135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.239970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:12.247543 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8ea9ea11-f56d-4b23-89c8-88d8a18bec5c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.146894 Aug 30 16:20:12.248118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 185/374] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:12 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:12.446772 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:12.447696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:12.454564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.455055 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.455537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.456238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.456700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.457134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.468030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:12.468643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:12.475045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.475540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.475979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.476673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:12.477173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:12.477599 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.592179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:12.600305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b148f841-096b-40cd-b794-3f389c957c6c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.157293 Aug 30 16:20:12.600886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 190/375] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:12 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:12.612180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:12.619858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1e26dff7-e743-439b-ad2b-559adbd3b596 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.156300 Aug 30 16:20:12.620416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 186/376] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:12 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:13.268684 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:13.269611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:13.271570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:13.272533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:13.278890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.279411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.279857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.280574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.281029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.281454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.326852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "name": "network-vif-plugged", "status": "completed", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:13.339147 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.340251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.340690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.353212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] Creating event network-vif-plugged:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:20:13.359272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-735d57af-6af8-40ef-baaf-5c7391c0a48d req-12b92496-6100-412b-bc87-17ddc8f99e0b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036129 Aug 30 16:20:13.360045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 187/377] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:13.417953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:13.426420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce4224f6-6f05-44e5-8956-39bda7fe7d9b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.161819 Aug 30 16:20:13.427181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 191/378] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:13 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:13.621405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:13.622097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:13.624534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:13.630923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.631449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.631889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.632623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.633079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.633501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.645095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:13.646228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:13.655167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.655726 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.656170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.656880 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.657337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.657773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.773228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:13.783332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1a9140d4-2999-4951-85c4-931d9ed1ca8c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.165933 Aug 30 16:20:13.783906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 188/379] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:13 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:13.801168 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:13.810144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-990f07ce-1c15-447d-8a08-7dff604c2485 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.171222 Aug 30 16:20:13.810725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 192/380] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:13 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:14.447175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:14.447812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:14.454460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.454937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.455396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.456079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.456543 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.456952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.586870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:14.595110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4c30b602-383a-41e5-b27e-e337addcd6c5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.151485 Aug 30 16:20:14.595110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 189/381] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:14 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:14.804157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:14.804763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:14.811494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.811978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.812411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.813177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.813532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.813953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.832464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:14.832957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:14.839425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.839941 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.840613 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.841422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.842009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.842535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.997229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:15.006988 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-77d5bcd2-2a6d-43aa-835e-6b6208912468 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.179253 Aug 30 16:20:15.007824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 190/382] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:14 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:15.189685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:15.197312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7fedd3d8-763d-4d04-b9ad-474cb8d1b34e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.397088 Aug 30 16:20:15.197871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 193/383] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:14 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:15.615735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:15.616352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:15.623368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:15.623856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:15.624290 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:15.624990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:15.625450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:15.625875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:15.759912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:15.768350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-329b79f0-c0f8-4010-9234-595660f901bb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.156482 Aug 30 16:20:15.768923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 191/384] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:15 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:16.028287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:16.028804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:16.034685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.035207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.035680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.036376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.036838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.037269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.041162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:16.167807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:16.176021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f7389a3-51fd-40cd-816b-dbc8c0a440d2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.151804 Aug 30 16:20:16.176580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 194/385] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:16 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:16.218437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:16.219085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:16.225097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.225583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.226011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.226711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.227160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.227646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.360160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:16.368734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-282330d2-3f00-4a3a-a976-61e5479a5640 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.154378 Aug 30 16:20:16.369335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 192/386] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:16 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:16.788990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:16.789608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:16.795640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.796130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.796576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.797557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.797719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.798180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.962412 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:16.985471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6e3123f-514f-4ea7-9640-bce021931946 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.200205 Aug 30 16:20:16.986106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 195/387] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:16 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:17.197358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:17.197897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:17.204455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.204941 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.205381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.206079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.206540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.206967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.341691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:17.349347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1703c526-e69f-4be5-9423-e2e03b75cdd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.155989 Aug 30 16:20:17.349911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 193/388] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:17 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:17.390671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:17.391289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:17.397273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.397773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.398222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.398919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.399426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.399859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.530345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:17.537973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0a90d05-b538-4839-ba33-8a862f0522fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.151908 Aug 30 16:20:17.538535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 196/389] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:17 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:18.007248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:18.007884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:18.014042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.014472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.014977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.015693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.016143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.016687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.151097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:18.159400 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3f77337b-c667-4982-8052-b5aaaab76cad tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.156584 Aug 30 16:20:18.160115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 194/390] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:18 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:18.369757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:18.370370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:18.376440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.377197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.377641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.378339 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.378794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.379238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.511117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:18.519277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1a896ca-fc2f-418d-824f-abaa38b30c60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.153426 Aug 30 16:20:18.519852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 197/391] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:18 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:18.559312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:18.559836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:18.566425 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.566966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.567427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.568115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:18.568565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:18.568983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:18.696701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:18.704964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3d3b1ad1-d7a6-40aa-b864-ee9d09ed80ba tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.149654 Aug 30 16:20:18.705525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 195/392] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:18 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:19.180535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:19.181241 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:19.188041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.188601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.188966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.189669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.190132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.190566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.320042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:19.327699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a14cc77-e214-4ed9-b0c6-af8c6bf53bef tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.151258 Aug 30 16:20:19.328271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 198/393] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:19 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:19.540699 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:19.541209 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:19.547911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.548407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.548879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.549627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.550264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.550607 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.688850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:19.696702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2608a95e-8957-4560-b236-19750b14e5db tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.160034 Aug 30 16:20:19.697266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 196/394] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:19 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:19.727015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:19.727662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:19.735057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.735572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.736009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.736715 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.737167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.737594 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.876579 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:19.884934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba601f1d-b7dd-4f83-9df1-f1e021618922 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.163089 Aug 30 16:20:19.885519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 199/395] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:19 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:20.348364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:20.348985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:20.355257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.355831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.356265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.356962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.357415 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.357837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.509987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:20.519078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-84ae008b-8b7f-4945-85c8-d5234993bfe1 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.174532 Aug 30 16:20:20.519854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 197/396] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:20 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:20.717753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:20.718374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:20.724433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.725131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.725754 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.726460 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.726919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.727383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.872996 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:20.881899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-219705ce-6a1d-43c2-89e4-b6a38457f3da tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.167909 Aug 30 16:20:20.882473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 200/397] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:20 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:20.910714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:20.910714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:20.914697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.915670 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.916107 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.917024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.917270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.917915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:21.090360 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:21.098285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fc5d9f72-be20-43fd-a978-d65b14f5cd9d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.196169 Aug 30 16:20:21.098894 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 198/398] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:20 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:21.540467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:21.541136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:21.548586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.549281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.549877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:21.551258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.551258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.551946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:21.712670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:21.722196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec3334a5-39e4-4740-9d82-461d56e30318 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.185485 Aug 30 16:20:21.731575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 201/399] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:21 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:21.901981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:21.903359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:21.909470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.909959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.910399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:21.911095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.911649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.911999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.050880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:22.053168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:22.061518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bc87f8f9-9dea-495c-8f75-98e4d16e1d78 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.162451 Aug 30 16:20:22.062135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 199/400] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:21 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:22.118597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:22.119263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:22.125321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:22.125896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:22.126343 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.127589 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:22.128122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:22.128705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.262217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:22.271146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5b85626-2259-4ce7-ad24-c780729b03ef tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.155767 Aug 30 16:20:22.271285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 202/401] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:22 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:22.744970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:22.745618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:22.752572 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:22.753068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:22.753505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.754218 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:22.754670 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:22.755092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.897058 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:22.905665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0fd41b92-e252-471f-ae9f-ba21605330d4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.164706 Aug 30 16:20:22.906232 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 200/402] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:22 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:23.081980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:23.082593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:23.088784 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.089211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.089652 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.090355 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.090813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.091268 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.221359 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:23.229080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09281001-3a00-435d-8414-3076a274c9f7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.151007 Aug 30 16:20:23.229649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 203/403] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:23 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:23.290579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:23.291186 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:23.298276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.299041 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.299581 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.300283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.300912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.301163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.442177 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:23.450758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-63a2a6fc-8d8b-40c5-b84c-ca83a2aad50e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.164066 Aug 30 16:20:23.451337 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 201/404] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:23 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:23.925995 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:23.926607 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:23.932700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.933180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.934113 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.934804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.935288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.935721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.066030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:24.073928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67c64be7-b193-4886-8d03-dda29799fe97 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.151673 Aug 30 16:20:24.075596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 204/405] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:23 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:24.252546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:24.253206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:24.259440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.259926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.260359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.261065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.261510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.262632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.400588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:24.408500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c502dbcd-0a87-437e-80c9-1326e03d0d1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.161542 Aug 30 16:20:24.409077 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 202/406] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:24 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:24.471545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:24.472167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:24.478582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.479121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.479672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.480318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.481286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.481768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.698838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:24.707352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3018e5d2-9235-43a8-9609-390904ea75e4 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.240002 Aug 30 16:20:24.708028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 205/407] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:24 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:25.022787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:25.032849 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.033325 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.033755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.044894 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] Creating event network-changed:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:20:25.049740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-49012def-ffb0-4b68-8c24-11fbca5f96ac req-b0f55d00-9b5b-475b-b93b-d8d7c87734e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030567 Aug 30 16:20:25.050499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 203/408] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:25.095292 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:25.095907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:25.102121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.102618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.103061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.103876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.104651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.105303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.247258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:25.255616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06720191-e777-4452-ba74-46fe9df0bf2a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.164140 Aug 30 16:20:25.256593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 206/409] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:25 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:25.432963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:25.434311 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:25.441935 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.442591 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.443379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.444079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.444648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.445147 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.665010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:25.672837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0c4b7b40-d270-4898-9921-2b4dcdedbf2a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1271 microversion: 2.1 time: 0.246537 Aug 30 16:20:25.673408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 204/410] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:25 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:25.728705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:25.729310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:25.738506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.739165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.740038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.741104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:25.741583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:25.741997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.872564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:25.880747 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3e0712b-2cab-408b-a6e9-15664c4b64d5 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.155929 Aug 30 16:20:25.881327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 207/411] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:25 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:26.277926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:26.278675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:26.284637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.285122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.285560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.286254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.286713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.287140 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.431210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:26.444020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f4f93a83-4e32-43aa-baab-10f6861c9a50 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1357 microversion: 2.1 time: 0.170335 Aug 30 16:20:26.459499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 205/412] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:26 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:26.694041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:26.695023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:26.703669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.705081 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.705597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.706393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.706928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.707495 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.874942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:26.884256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-382b0dc5-e4f3-4b0e-9dc9-9c38620921eb tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.194103 Aug 30 16:20:26.884863 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 208/413] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:26 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:26.901750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:26.902889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:26.908819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.909308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.909750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.910528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.910951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.911398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.053874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:27.061741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-adcb3ca3-e66e-4498-802f-d7fe2dc65b0a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.163820 Aug 30 16:20:27.062329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 206/414] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:26 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:27.087631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "name": "network-vif-plugged", "status": "completed", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:27.097799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.098169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.099240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.111041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] Creating event network-vif-plugged:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:20:27.116251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-900b8651-75e7-4c71-9f7f-dbaac9c2a84a req-9f792bca-59de-4f0d-992e-0715a8a07228 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032339 Aug 30 16:20:27.116860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 209/415] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:27.466253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:27.466861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:27.473571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.474070 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.474500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.475188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.475666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.476086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.607301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:27.615815 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-66f68709-d143-4973-9ae9-da8b2895df75 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1546 microversion: 2.1 time: 0.154322 Aug 30 16:20:27.616388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 207/416] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:27 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:27.637993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:27.638696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:27.644925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.645408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.645920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.646874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.647433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.647960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.864261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:27.873079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c548c59a-85d6-4e8c-9f6d-28d2ba23a8b0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1546 microversion: 2.1 time: 0.239724 Aug 30 16:20:27.873666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 210/417] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:27 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:27.893777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:27.899397 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:27.900273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Searching by: {'deleted': False, 'project_id': '568821f418bb465193aac9ec311b59b2'} {{(pid=120589) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:20:27.906043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:27.907289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:27.908082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.908742 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.909175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.909896 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.910339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.910903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.914947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.915690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.916591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.918062 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:27.919028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:27.919542 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.937687 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:28.036896 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.multi_cell_list [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:20:28.080609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:28.088622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59b2e83a-9ee0-4d10-aed4-816021f22c1d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.186519 Aug 30 16:20:28.089290 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 211/418] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:27 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:28.094040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:28.094781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:28.100730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:28.101320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:28.101906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:28.102622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:28.103082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:28.103545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:28.131743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f545c57e-2633-4a53-a856-4336f5718928 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.241611 Aug 30 16:20:28.132327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 208/419] 10.222.0.57 () {58 vars in 1125 bytes} [Tue Aug 30 16:20:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:28.144007 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:28.144625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:28.151661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:28.152193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:28.152670 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:28.153382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:28.154151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:28.154283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:28.318235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:28.327026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:28.334877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7969aa3e-d342-4e19-a40f-88c1746ced08 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.244476 Aug 30 16:20:28.345223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c999d952-8c13-4af3-a1c0-2960661703b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1546 microversion: 2.1 time: 0.204902 Aug 30 16:20:28.346121 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 209/420] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:28 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:28.347724 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 212/421] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:28 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:29.108840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:29.109725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:29.116474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.117051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.117559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.118469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.118925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.119441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.255197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:29.263589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4b489251-d162-4e37-b49e-3cfddc9ed815 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.158742 Aug 30 16:20:29.264176 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 210/422] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:29 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:29.355364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:29.355998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:29.362051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.362528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.362963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.363679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.364151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.364554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.504535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:29.513007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28e21df2-b931-4f5c-bf30-7d891ccd8535 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1371 microversion: 2.1 time: 0.161458 Aug 30 16:20:29.513580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 213/423] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:29 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:29.912320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65caea7c-9857-4c54-8495-aa0afe0d6609"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:29.914860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:29.922087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.922676 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.923447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.924039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.924565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.925059 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.285658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:30.286270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:30.292779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.293265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.293698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.294390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.295013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.295628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.453721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:30.463554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ba97ca0-3396-44ac-b0f0-764ee18faef9 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.182810 Aug 30 16:20:30.465242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 214/424] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:30 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:30.535191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:30.535191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:30.541048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.541552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.542048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.542948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.543571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.544007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.727074 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:30.734869 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb4b2e20-3d9a-4753-a1af-b49447b6f14f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1565 microversion: 2.1 time: 0.204797 Aug 30 16:20:30.735486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 215/425] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:30 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1565 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:30.756669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:30.757290 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:30.764129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.764627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.765068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.765916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:30.766379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:30.766943 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.794434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-76e4082c-8f33-4c23-8000-97e3b25909ce tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.886108 Aug 30 16:20:30.795675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 211/426] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:20:29 2022] POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:30.877450 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73ffd12f-e42b-4869-8824-910314d61bd6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124785 Aug 30 16:20:30.878061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 216/427] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:20:30 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:31.487409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:31.488426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:31.496457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:31.496957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:31.497399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:31.498115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:31.498569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:31.499269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:31.748240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:31.756241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b126de21-f28e-4305-946d-d303dfc37fd3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.274904 Aug 30 16:20:31.756821 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 212/428] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:31 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:32.044110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:32.053380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:32.053863 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:32.054294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:32.066411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] Creating event network-changed:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:20:32.071785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-da15bf0f-6d0f-4409-a884-b26fab003a56 req-5a786ec3-7f38-4f34-a538-f17d37ff2129 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Aug 30 16:20:32.072707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 217/429] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:32.778672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:32.779432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:32.786094 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:32.786574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:32.786998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:32.787751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:32.788204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:32.788610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:32.925486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:32.934152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e53a857e-dfd1-4611-a49b-803b3bd93511 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.159348 Aug 30 16:20:32.934764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 213/430] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:32 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:33.954669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:33.955469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:33.961901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:33.962390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:33.962825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:33.963551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:33.964017 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:33.964448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.101165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:34.109072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9e8fc2c-001f-4ff3-96ed-2697107cea44 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.158756 Aug 30 16:20:34.109639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 218/431] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:33 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:35.128674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:35.129288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:35.135652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:35.136135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:35.136574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:35.137265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:35.137711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:35.138130 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:35.269485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:35.277614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-09b03e84-6db7-4f1e-baa2-51264dfcb535 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.152456 Aug 30 16:20:35.278182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 214/432] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:35 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:36.298303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:36.298953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:36.305471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:36.305907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:36.306347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:36.307084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:36.307573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:36.308004 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:36.445262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:36.453107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3bfe1f9-4822-4a4e-ada2-4bb2e7d6d971 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.158695 Aug 30 16:20:36.453667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 219/433] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:36 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:37.476554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:37.477452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:37.487810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.488547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.489188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:37.490255 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.490947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.491622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:37.517873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:37.650993 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:37.660473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9488525d-f626-47bd-9273-1f3335cb36bc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.190252 Aug 30 16:20:37.668270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 215/434] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:37 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:38.423804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:38.424530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:38.429914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=74 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:38.431956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.432645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.433283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.434160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.434824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.435541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.582760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:38.592031 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cbd5950-897c-4993-a49b-8e17cbdf4653 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1592 microversion: 2.1 time: 0.172337 Aug 30 16:20:38.592624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 220/435] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:38 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1592 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:38.683551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:38.684289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:38.687106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:38.691457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.691870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.692308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.693010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.693465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.693892 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.874462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:38.883483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-415d5cfe-5771-42c8-a6f6-d59cbe390a85 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.205861 Aug 30 16:20:38.884076 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 216/436] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:38 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:39.906526 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:39.907872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:39.914668 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.915486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.915929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.916656 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.917106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.918106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.254154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:40.263545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-573a9293-dfc5-46f7-92fa-e81c406577b2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.361217 Aug 30 16:20:40.264288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 221/437] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:39 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:40.747549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:40.758798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=72 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:40.765918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:40.766608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:40.767304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.780574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] Creating event network-changed:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:20:40.786985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-63b226e9-838a-424b-8436-dacdee0ee07c req-71e3fbda-52cf-4b1f-b9b5-7e0c963c71b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043569 Aug 30 16:20:40.788156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 217/438] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:41.287850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:41.289478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:41.300031 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.301523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.302283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:41.303263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.303947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.305077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:41.393094 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "name": "network-vif-plugged", "status": "completed", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:41.411572 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.412086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.412517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:41.439411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] Creating event network-vif-plugged:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:20:41.448473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-393f5783-edc9-4cae-9955-8470035643e3 req-36b66cbe-8929-4d2c-9b6f-40d92a5675e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059803 Aug 30 16:20:41.449420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 218/439] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:41.570833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:41.582439 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-960b41ee-50d5-480a-be81-d64ea940e24a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.300059 Aug 30 16:20:41.596569 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 222/440] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:41 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:41.950993 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-52949364"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:41.951653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:41.958237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.958730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.959168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:41.959906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.960371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.960793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.096963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.network.security_group_api [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Adding security group 85c0fe07-87cb-4b9a-8c22-30f9e1ca9e3b to port 4d43c92c-0daf-4310-874f-a1d618cff05a Aug 30 16:20:42.606198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:42.606896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:42.613746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.614326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.614843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.615675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.616374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.616813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.665613 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-435d98e8-58a0-4cb5-bd2f-80e0df3fd67c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action" status: 202 len: 0 microversion: 2.1 time: 0.719867 Aug 30 16:20:42.666226 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 219/441] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:20:41 2022] POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:20:42.675240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:42.675859 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:42.683346 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.684218 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.684884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.685837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.686511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.687467 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.833665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:42.842491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4932a758-672c-484b-a2ff-79cad363699e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1259 microversion: 2.1 time: 0.240991 Aug 30 16:20:42.856154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 223/442] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:42 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:42.862474 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:42.873830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.874553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.875163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.888517 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] Creating event network-changed:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:20:42.894265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bee42291-7bf4-4158-90d0-805bd9e78f3d req-f9ced4f2-c2db-472a-a0ac-e80c18504f8b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036755 Aug 30 16:20:42.895522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 224/443] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:42.907831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:42.917985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7b125c38-e81c-44af-82bc-f9461c848ea8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1756 microversion: 2.1 time: 0.245873 Aug 30 16:20:42.919180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 220/444] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:42 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:43.869144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:43.869840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:43.878076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:43.878573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:43.879005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:43.879766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:43.880229 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:43.880646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:44.118194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:44.129792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83c01b85-75e5-4a7d-abfa-6dbb9d1f8fd1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1442 microversion: 2.1 time: 0.264860 Aug 30 16:20:44.130783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 225/445] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:43 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1442 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:44.152164 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:44.154088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:44.165884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:44.171043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:44.172111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:44.173332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:44.174013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:44.174984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:44.349010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:44.359078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e9f34f90-2f01-4e62-86a1-376c771c4665 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1442 microversion: 2.1 time: 0.211135 Aug 30 16:20:44.359625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 221/446] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:44 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1442 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:46.176686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:46.191655 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:46.192527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:46.193130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:46.206116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] Creating event network-changed:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:20:46.211597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1cf14a37-84f6-49b4-87b3-0a5be7ddb0e6 req-e9fc2683-a990-4465-8749-e5cfa4cb3693 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038685 Aug 30 16:20:46.212189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 226/447] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:46.331469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-420573158", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "networks": [{"uuid": "8d4d449b-0365-4529-bd8e-b94bfbf39766"}]}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:46.395411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] validate_networks() for [('8d4d449b-0365-4529-bd8e-b94bfbf39766', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:46.800267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:20:46.800691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:20:46.801338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:20:46.801901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:20:46.802386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:20:46.811837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:46.812327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:46.812757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:46.813657 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:46.814183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:46.814566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:46.834444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Getting quotas for project 80405e8d445d49199ed0d9ccd014dfb7. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:20:46.838539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Getting quotas for user 651091dd88274d2cb0b5b7afc0a18e5e and project 80405e8d445d49199ed0d9ccd014dfb7. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:20:46.851470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:20:46.853772 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:20:46.915001 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3a5fb36c-e40a-451b-94f6-b37794ecd41f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587581 Aug 30 16:20:46.921582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 222/448] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:20:46.927245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae9e3ba2-6c03-4a45-ad4b-9390b40b317f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:46.927975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae9e3ba2-6c03-4a45-ad4b-9390b40b317f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:46.989293 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae9e3ba2-6c03-4a45-ad4b-9390b40b317f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:46.997195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae9e3ba2-6c03-4a45-ad4b-9390b40b317f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1218 microversion: 2.1 time: 0.074127 Aug 30 16:20:46.997583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 227/449] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:46 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:48.019399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:48.020110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:48.027962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.028448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.028885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.029582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.030038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.030463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.095821 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:48.103703 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c5f09383-01c1-4ac2-b7aa-b8df1a989b6e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1270 microversion: 2.1 time: 0.088143 Aug 30 16:20:48.104282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 223/450] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:48 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:49.125539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:49.126163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:49.134891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:49.135416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:49.135865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:49.136604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:49.137062 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:49.137484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:49.352129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:49.360595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-734a06d9-dcbf-4da2-82ee-cf7a0c0d9285 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.238977 Aug 30 16:20:49.364946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 228/451] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:49 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:49.607100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2859998f-2b64-4274-a3c1-2f0606306a22", "tag": "21208032-0d1d-4e24-a8e3-bf91b58c0c06"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:49.619197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:49.619765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:49.620794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:49.633486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] Creating event network-changed:21208032-0d1d-4e24-a8e3-bf91b58c0c06 for instance 2859998f-2b64-4274-a3c1-2f0606306a22 on hv-cinder-85220 Aug 30 16:20:49.639245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-bfd19333-a176-4ec5-a733-9077e0f24926 req-02a8a068-7e32-4d84-bd98-80b4de4bff48 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038575 Aug 30 16:20:49.639998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 224/452] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:50.382583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:50.383250 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:50.389256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.389742 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.390183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.390874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.391368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.391800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.523953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:50.532484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e374b787-7757-4e1f-9a48-b005a57d584f tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.154002 Aug 30 16:20:50.533051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 229/453] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:50 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:51.554378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:51.555089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:51.562110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:51.562594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:51.563034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:51.563769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:51.564222 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:51.564647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:51.693195 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:51.700874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b6d81e9b-8a71-44df-a5d1-e37c822998ea tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.151374 Aug 30 16:20:51.701434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 225/454] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:51 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:52.721848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:52.722460 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:52.728371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:52.728910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:52.729351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:52.730046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:52.730530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:52.730963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:52.867050 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:52.875327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1d9e02c-2e82-460c-8d66-e5552b0dc9dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.157510 Aug 30 16:20:52.875896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 230/455] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:52 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:53.896416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:53.897066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:53.903480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:53.903953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:53.904382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:53.905095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:53.905542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:53.905958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:54.038719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:54.046297 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-141bc53a-8b41-4e8e-83f2-726b42274ecd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.153828 Aug 30 16:20:54.046856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 226/456] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:53 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:55.068323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:55.068947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:55.075689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:55.076182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:55.076620 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:55.077324 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:55.077818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:55.078254 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:55.094301 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:55.210988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:55.219367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e912f9be-72e9-4567-af78-bf5bacb432e7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.155160 Aug 30 16:20:55.219957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 231/457] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:55 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:56.239608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:56.240219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:56.246675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:56.247161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:56.247631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:56.248320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:56.248776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:56.249203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:56.391035 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:56.400464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d8540373-aee9-4397-a912-b3010451e33b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.164673 Aug 30 16:20:56.401040 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 227/458] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:56 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:57.200903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2859998f-2b64-4274-a3c1-2f0606306a22", "name": "network-vif-plugged", "status": "completed", "tag": "21208032-0d1d-4e24-a8e3-bf91b58c0c06"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:57.206244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:57.215029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:57.215540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:57.216526 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:57.228191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] Creating event network-vif-plugged:21208032-0d1d-4e24-a8e3-bf91b58c0c06 for instance 2859998f-2b64-4274-a3c1-2f0606306a22 on hv-cinder-85220 Aug 30 16:20:57.234207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6b75356c-f45d-4bff-a032-07a51681d407 req-6374e210-9e24-4447-82d3-6c4debe8b54d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Aug 30 16:20:57.234823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 232/459] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:57.422064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:57.422692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:57.424762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:57.425419 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:57.431978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:57.432469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:57.433481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:57.434197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:57.434653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:57.435086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:57.570404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:57.578212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fbbbb757-90fd-463a-b09f-737daa116a89 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.160252 Aug 30 16:20:57.578813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 228/460] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:57 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:58.599723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:58.600454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:58.606588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:58.607075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:58.607538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:58.608227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:58.608689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:58.609113 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:58.740345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:58.748409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2bea275-9b4e-4e37-9573-5943afae51bd tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.153132 Aug 30 16:20:58.748975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 233/461] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:58 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:59.770030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:59.770560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:59.777865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:59.778346 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:59.778782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:59.779503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:59.779960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:59.780386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:59.921415 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:59.929497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-32da0c43-3cad-42c3-ac20-576cfc761302 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1318 microversion: 2.1 time: 0.163381 Aug 30 16:20:59.930074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 229/462] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:59 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:00.950753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:00.951413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:00.957404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:00.957888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:00.958335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:00.959029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:00.959512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:00.959944 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.088444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:01.097503 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15d20028-16b6-476a-a031-a32aa9e31b34 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1506 microversion: 2.1 time: 0.150550 Aug 30 16:21:01.098213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 234/463] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:00 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:05.648589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:05.649084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:05.656216 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:05.656699 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:05.657135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:05.657829 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:05.658287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:05.658709 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:05.682113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-cf689528-d11a-4247-8e5d-2ab63f8f5ab7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/ips" status: 200 len: 151 microversion: 2.20 time: 0.037373 Aug 30 16:21:05.682691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 230/464] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 30 16:21:05 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:21:07.723425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:07.724011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:07.730441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.730987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.731457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.732691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.733150 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.733576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.763142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lazy-loading 'flavor' on Instance uuid bef6f406-1466-4883-bb22-2f778347bfac {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:21:07.960152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18981d84-f2b0-4953-a71a-1ebbdd4fcc38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/action" status: 202 len: 0 microversion: 2.20 time: 0.241121 Aug 30 16:21:07.960755 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 235/465] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 30 16:21:07 2022] POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:07.969818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:07.970581 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:07.977299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.977758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.978187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.978966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.979445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.979880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.984131 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=74 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:08.123511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:08.132669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:08.134337 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:08.135531 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8573f597-98de-4066-b949-3a0870e2d5af tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.170346 Aug 30 16:21:08.136103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 231/466] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:07 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:09.159551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:09.160251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:09.162539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=34 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:09.169534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.170029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.170470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.171184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.171669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.172091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.308999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:09.317427 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:09.318964 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:09.320149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a414052c-24f6-4a8f-b1c4-e8ae026657e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.164931 Aug 30 16:21:09.320713 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 236/467] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:09 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:09.739686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:09.740267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:09.747359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.747849 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.748433 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.748991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.749445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.749874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.774263 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-640e0c0b-22f9-4c52-be87-25e57b449e95 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/ips" status: 200 len: 146 microversion: 2.1 time: 0.038465 Aug 30 16:21:09.774798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 232/468] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:21:09 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:10.344400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:10.345005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:10.350965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.351483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.351922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:10.352719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.353173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.353674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:10.486921 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:10.495914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:10.497431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:10.498612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-725f4d06-2d06-4aa5-a0fc-cc716f7a01bb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.158837 Aug 30 16:21:10.499177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 237/469] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:10 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:11.521981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:11.522587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:11.525106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:11.531771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:11.532265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:11.532694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:11.533416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:11.533866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:11.534288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:11.669289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:11.677577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:11.679034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:11.680236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-81db92cf-f39a-4f17-9225-11cfb5fb1c19 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.162175 Aug 30 16:21:11.680812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 233/470] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:11 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:12.294151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab128659-20b3-4248-837c-483ee7d1aa89"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:12.296506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:12.302788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.303316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.303761 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.304453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.304917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.305347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.583685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efc14ad7-ea93-4ab9-af83-c1197a74620d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293780 Aug 30 16:21:12.584530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 238/471] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:21:12 2022] POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:12.703299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:12.703918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:12.710432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.710937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.711399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.712103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.712560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.712992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.848914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:12.857855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:12.859361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:12.860535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6a27ab40-50f1-490b-844b-304545d25d5f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.161428 Aug 30 16:21:12.861287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 234/472] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:12 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:13.885120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:13.885822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:13.893039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:13.893541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:13.893983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:13.894688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:13.895146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:13.895608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:14.029896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:14.037891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:14.039372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:14.040514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d11db97-e346-4cb6-b089-f6b458df1fe6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.160565 Aug 30 16:21:14.041066 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 239/473] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:13 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:15.064187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:15.064761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:15.070871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:15.071385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:15.071818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:15.072500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:15.072945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:15.073383 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:15.202636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:15.210753 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:15.212334 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:15.213372 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3f0eb978-a661-4f3a-af9e-e5f06b6783f8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.153787 Aug 30 16:21:15.214010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 235/474] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:15 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:16.236009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:16.236623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:16.242914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.243459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.243903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.244607 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.245069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.245500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.384117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.392811 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.394242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.395417 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42dba4c7-1125-463e-95e1-dafe2c382c4b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.163328 Aug 30 16:21:16.395979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 240/475] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:16 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:17.418167 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:17.418871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:17.426125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.426615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.427052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.427776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.428234 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.428661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.561901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:17.570223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:17.571734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:17.572897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-98b415d7-d5e3-4f0d-a46a-14a31e75e9c0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.158838 Aug 30 16:21:17.573464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 236/476] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:17 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:18.596883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:18.597710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:18.604548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.605038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.605478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.606180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.607314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.607750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.738222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.746257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.747744 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.748897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a15b6b22-3067-4544-aa98-a77813d45c5e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.156090 Aug 30 16:21:18.749462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 241/477] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:18 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:19.771734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:19.772313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:19.779590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.780071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.780505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.781203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.781654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.782080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.916468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:19.924779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:19.926231 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:19.927640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-92bb2fae-c983-4fa0-ab7c-c361664f983d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.159736 Aug 30 16:21:19.928201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 237/478] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:19 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:20.120098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:20.126554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.127045 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.127797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.188069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Going to try to stop instance {{(pid=120588) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:21:20.232591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04fd9660-958b-420a-b1a6-423a051767a3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.115366 Aug 30 16:21:20.233211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 242/479] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:20 2022] POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:20.241725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:20.242567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:20.248948 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.249445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.249926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.250704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.251155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.251603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.385870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:20.393944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0ddc4685-fee7-4d30-be5e-e3607e83e13d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.156485 Aug 30 16:21:20.394512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 238/480] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:20 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:20.950419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:20.951105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:20.957201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.957683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.958120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.958799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.959268 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.959692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.100038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:21.109534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:21.111056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:21.112256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6315c7cc-ece0-4261-8826-a14bffe45b7f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.166171 Aug 30 16:21:21.112884 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 243/481] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:20 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:21.415635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:21.416259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:21.422611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.423089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.424296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.425194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.425852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.426281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.568469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:21.577422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5932fa39-345e-4df5-b6c5-edcc2d823d4d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.165789 Aug 30 16:21:21.578008 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 239/482] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:21 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:22.137615 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:22.138452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:22.145423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.145917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.146357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.147070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.147576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.148007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.163393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:22.281679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:22.290204 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:22.291465 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:22.292627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40d55ad6-cce3-4e54-9755-cdc7753309ab tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.160917 Aug 30 16:21:22.293200 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 244/483] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:22 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:22.600795 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:22.601512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:22.608790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.609274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.609712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.610438 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.610895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.611340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.744898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:22.753615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33d3d41d-de98-471f-b023-36d3d8fed98f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.158121 Aug 30 16:21:22.754178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 240/484] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:22 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:23.316480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:23.317117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:23.323534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.324026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.324462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.325796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.326253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.326679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.463631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.472786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.475138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.476945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34b1fe0a-1551-48e1-b7d9-83da8a3a3f6c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.164210 Aug 30 16:21:23.477784 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 245/485] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:23 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:23.774711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:23.775343 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:23.781823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.782309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.782748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.783475 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.783934 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.784359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.925793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.933881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b735b69d-c217-414a-b85e-a34a97f7a031 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.163065 Aug 30 16:21:23.934476 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 241/486] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:23 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:24.500164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:24.500809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:24.507626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.508115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.508555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.509257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.509720 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.510149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.642164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:24.650627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:24.652109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:24.653329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45972b7d-e98e-4950-81fc-12bbb78fee87 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.157054 Aug 30 16:21:24.653893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 246/487] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:24 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:24.954525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:24.955173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:24.961819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.962303 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.962732 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.963448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.963899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.964321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.093840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:25.101994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8fc53be2-e522-469e-937c-4d3de08377e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.151966 Aug 30 16:21:25.102558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 242/488] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:24 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:25.675904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:25.676542 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:25.682948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:25.683469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:25.683908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.684612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:25.685101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:25.685529 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.820391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:25.828897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:25.830333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:25.831515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67764b83-234f-4020-a25b-36396e204bbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.159471 Aug 30 16:21:25.832066 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 247/489] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:25 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:26.123525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:26.124068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:26.131091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.131615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.132052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.132877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.133401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.133924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.270252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:26.278722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c7199acd-3679-4004-bff3-3090e3e4d94d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.159660 Aug 30 16:21:26.279440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 243/490] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:26 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:26.823281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "673d7bb7-5faf-43c9-a4c5-e44757373f45", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:26.826267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:26.832671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.833152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.833590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.834277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.834732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.835158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.855004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:26.855658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:26.862532 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.863042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.863536 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.864238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.864692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.865578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:27.001353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:27.010649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:27.012123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:27.013271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-54ad2232-aca0-4ecc-b250-35c0285866f4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.162177 Aug 30 16:21:27.013825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 244/491] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:26 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:27.082895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b76cafe8-52e1-4630-9abe-018d6fc5adab tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "POST /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263370 Aug 30 16:21:27.083556 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 248/492] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:21:26 2022] POST /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:27.300080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:27.301663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:27.308709 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:27.309242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:27.309675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:27.310368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:27.310880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:27.311260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:27.444546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:27.453952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bb1d55e7-3e5b-4919-94c6-137a52bf2341 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.157821 Aug 30 16:21:27.454832 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 245/493] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:27 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:28.038814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:28.039566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:28.045764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.046255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.046699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:28.047435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.047899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.048333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:28.179105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:28.188041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:28.189505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:28.190738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f62e720-4a53-4be2-a8eb-b6cd212af985 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.156741 Aug 30 16:21:28.191345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 249/494] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:28 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:28.476000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:28.476602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:28.483792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.484281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.484724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:28.485459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.485919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.486349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:28.617567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:28.626509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c87a1570-499b-491f-ab17-f83e86248f68 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.154385 Aug 30 16:21:28.627087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 246/495] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:28 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:29.216775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:29.217388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:29.224327 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.225004 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.225414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.226133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.226597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.227058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.361458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:29.369649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:29.371111 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:29.372351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e547d58-f9b9-4b2d-982e-3834fdf45a4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.160024 Aug 30 16:21:29.372915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 250/496] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:29 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:29.424471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "name": "network-vif-plugged", "status": "completed", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:29.434574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.435179 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.435727 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.448592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] Creating event network-vif-plugged:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:21:29.454843 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-64a8219d-c110-4b1a-bb08-551d45bd373f req-2f305717-0793-403a-ba5b-56b2dff928e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Aug 30 16:21:29.455518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 247/497] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:29.647887 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:29.648487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:29.655352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.655352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.655824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.656524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.657012 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.657478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.790078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:29.798243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-054abb49-98c2-440e-96a7-33a0cd06bb54 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.154267 Aug 30 16:21:29.798807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 251/498] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:29 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:30.397203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:30.397903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:30.404559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.405074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.405507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.406199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.406652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.407078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.541873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:30.544830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=100 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:30.552807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:30.554261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:30.555449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8cfd4946-ceba-4189-813d-ba51eaac212a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.163125 Aug 30 16:21:30.556020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 248/499] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:30 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:30.820295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:30.820828 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:30.827831 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.828317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.828760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.829451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.829903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.830328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.960711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:30.969538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8404245f-39b2-4576-9633-ec50eb3622fc tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.153222 Aug 30 16:21:30.970101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 252/500] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:30 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:31.578158 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:31.578773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:31.585652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:31.586144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:31.586580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:31.587472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:31.587883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:31.588309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:31.721778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:31.729957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:31.731995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:31.733185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ad2e6fb9-768e-442a-9c79-92df6e6585f0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.158956 Aug 30 16:21:31.733761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 249/501] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:31 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:31.989926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:31.990539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:31.996962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:31.997447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:31.997886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:31.998575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:31.999166 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:31.999538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:32.130260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:32.139096 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05415003-7d07-42a7-82d7-e8b7cbcb415d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.153040 Aug 30 16:21:32.139701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 253/502] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:31 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:32.759326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:32.760453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:32.770235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:32.770987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:32.771686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:32.772765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:32.773472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:32.774127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:32.904125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:32.912193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:32.913647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:32.914809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-570deda0-8eff-424d-8ff6-ce6c1154d04b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.160324 Aug 30 16:21:32.915396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 250/503] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:32 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:33.159238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:33.159864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:33.166379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.166873 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.167342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:33.168047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.169146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.169581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:33.298164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:33.306447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a67ae3d3-4dbe-49fe-900e-0da6f015752c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.151093 Aug 30 16:21:33.307012 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 254/504] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:33 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:33.937997 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:33.938659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:33.945228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.945705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.946136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:33.946822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.947301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.947723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:34.081602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:34.089661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:34.091104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:34.092279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0054e28b-b77a-4377-9252-4e186b12772d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1743 microversion: 2.20 time: 0.158208 Aug 30 16:21:34.092841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 251/505] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:33 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:34.330609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:34.332657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:34.340432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:34.340926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:34.341372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:34.342087 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:34.342584 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:34.343095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:34.483133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:34.491571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01b0659e-a5e8-4a71-a723-853a302a2e06 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.168337 Aug 30 16:21:34.492137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 255/506] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:34 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:35.113877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:35.115141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:35.122236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:35.122804 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:35.123347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:35.124122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:35.124595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:35.125021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:35.273884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:35.294721 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:35.296490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:35.297711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-426ecff6-84be-4b9c-90be-702f376d0b82 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.187840 Aug 30 16:21:35.298375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 252/507] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:35 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:35.514552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:35.515910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:35.523965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:35.524513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:35.524897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:35.525558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:35.526182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:35.526820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:35.693938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:35.703429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3aa3350e-bde7-44b4-829b-279ce27090f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1725 microversion: 2.1 time: 0.193688 Aug 30 16:21:35.704019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 256/508] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:35 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:36.321848 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:36.322444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:36.329776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:36.330440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:36.330710 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:36.331450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:36.332122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:36.332553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:36.496875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:36.508143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:36.510292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:36.512874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3dc48f69-a1d7-4356-8884-b22347ed5bf4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.194050 Aug 30 16:21:36.534250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 253/509] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:36 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:36.725442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:36.726246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:36.733567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:36.734345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:36.735024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:36.736009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:36.736719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:36.737407 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:36.882043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:36.891908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-423e5cfe-e248-40b7-911c-58e20fa606c6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1702 microversion: 2.1 time: 0.170367 Aug 30 16:21:36.892669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 257/510] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:36 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1702 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:36.913675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:36.920562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:36.921133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:36.921674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:37.003813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Going to try to start instance {{(pid=120589) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:21:37.058451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-93bd5b56-e3cf-4f0d-8632-676a3c1ac102 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.148997 Aug 30 16:21:37.059387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 254/511] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:36 2022] POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:21:37.074294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:37.075138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:37.086275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:37.086904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:37.087505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:37.090562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:37.091434 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:37.092678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:37.255847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:37.264447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e3eef78-79a5-4b03-9390-ef61508365ab tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.200953 Aug 30 16:21:37.265328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 258/512] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:37 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:37.542192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:37.542882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:37.549968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:37.550475 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:37.550926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:37.551854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:37.552347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:37.552812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:37.738963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:37.749370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:37.751523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:37.752977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-af9ab61e-fa2f-4fb9-ba64-00074d0df4ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.215043 Aug 30 16:21:37.754322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 255/513] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:37 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:38.286317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:38.287052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:38.294093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:38.294586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:38.295029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:38.295773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:38.296236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:38.296666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:38.439559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:38.441903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:38.450256 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea467cc6-caa0-4f58-b530-5f7a406a74d1 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.167291 Aug 30 16:21:38.451103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 259/514] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:38 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:38.777219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:38.778128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:38.783985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:38.784487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:38.785327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:38.786036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:38.786490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:38.786931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:38.929595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:38.939940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:38.941553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:38.942784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-af51ab5f-53f0-451f-b857-b249c41b5055 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.170200 Aug 30 16:21:38.943404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 256/515] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:38 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:39.472300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:39.473740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:39.478563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=48 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:39.484944 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:39.485741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:39.486249 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:39.487123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:39.487680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:39.488189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:39.648154 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:39.657513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7db9120d-1f08-46c9-ac77-0cde67ce4177 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.189085 Aug 30 16:21:39.671171 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 260/516] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:39 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:39.976373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:39.977580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:39.986361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:39.987100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:39.987715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:39.988585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:39.989189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:39.989760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:40.153583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:40.164695 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:40.166480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:40.167975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ef3c514f-51f7-4852-88f8-f0225863c2b5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.197994 Aug 30 16:21:40.169154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 257/517] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:39 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:40.678063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:40.678685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:40.686121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:40.686726 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:40.687174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:40.687908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:40.688373 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:40.688807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:40.828562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:40.837724 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff26be8d-8a15-4c41-91d7-8f696dc0beec tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.163585 Aug 30 16:21:40.838574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 261/518] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:40 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:41.191127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:41.191731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:41.204323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:41.208576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:41.209293 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:41.210203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:41.211858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:41.212475 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:41.519071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:41.527376 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:41.528896 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:41.530049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-413f4653-b72a-40c2-acd4-ddb64bd8f223 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.342798 Aug 30 16:21:41.530604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 258/519] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:41 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:41.861250 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:41.861829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:41.868316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:41.868786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:41.869223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:41.869914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:41.870364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:41.870785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:42.014348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:42.023023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0743cf7-4efa-4654-96ff-9efdc059a299 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.165702 Aug 30 16:21:42.031926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 262/520] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:41 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:42.555069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:42.555825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:42.558680 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=52 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:42.564374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:42.565099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:42.565747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:42.566503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:42.566959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:42.567409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:42.723301 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:42.732289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:42.734108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:42.735646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c1a78842-724c-4b0c-8bd2-a43a0c963002 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.184553 Aug 30 16:21:42.745508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 259/521] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:42 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:43.045146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:43.046106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:43.052432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:43.053183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:43.053825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:43.054774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:43.055461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:43.056226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:43.216428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:43.225759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3a51435-d9c9-429e-b4e7-e4a589398161 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.185151 Aug 30 16:21:43.226842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 263/522] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:43 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:43.759143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:43.759791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:43.767678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:43.768432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:43.768881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:43.769800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:43.770281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:43.771036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:43.937207 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:43.945810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:43.947456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:43.948716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1a0dddb5-d192-4f13-af2a-fb17a803ea4d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.193623 Aug 30 16:21:43.949927 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 260/523] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:43 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:44.247930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:44.248784 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:44.256186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:44.257079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:44.257553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:44.258336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:44.258837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:44.259543 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:44.411287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:44.420803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99861420-1ef6-49d1-902a-ae2c6e47ab2e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.177573 Aug 30 16:21:44.421635 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 264/524] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:44 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:44.973424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:44.974152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:44.980452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:44.980958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:44.981398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:44.982103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:44.982569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:44.982965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:45.118956 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:45.127902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:45.129361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:45.130574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6dba7b89-a287-4fba-8fe7-d434856a62b4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.161555 Aug 30 16:21:45.131134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 261/525] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:44 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:21:45.444287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:45.444908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:45.451969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:45.452457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:45.452899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:45.453592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:45.454055 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:45.454516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:45.587727 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:45.596288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e3bb935-89a7-46d6-b867-adfac489a63b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1711 microversion: 2.1 time: 0.155491 Aug 30 16:21:45.596446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 265/526] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:45 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:46.154455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:46.155066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:46.161641 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:46.162119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:46.162551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:46.163252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:46.163708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:46.164131 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:46.531446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:46.539521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:46.540954 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:46.542097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d627f13e-a9b7-46c9-8c76-7efe5375f746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.392046 Aug 30 16:21:46.542652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 262/527] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:46 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:46.617223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:46.617833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:46.624315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:46.624800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:46.625238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:46.626061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:46.626522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:46.626948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:46.756661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:46.767049 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3990d42-b9ae-4bfa-953b-20ca9e1b08b3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1715 microversion: 2.1 time: 0.153341 Aug 30 16:21:46.768141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 266/528] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:46 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:47.568646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:47.568646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:47.573453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.574074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.575033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.575638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.576260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.576593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.710748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:47.719643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:47.721096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:47.722252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8976ef72-6eae-4cc0-ae00-3a370478dec9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1738 microversion: 2.20 time: 0.161300 Aug 30 16:21:47.722812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 263/529] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:47 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:48.745927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:48.747095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:48.753791 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.754277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.754719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.755444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.755903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.756334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.889480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.897446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.898886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.900132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f2514b6-d1f6-4d5a-aed0-290df0a4c2c6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1720 microversion: 2.20 time: 0.158182 Aug 30 16:21:48.900695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 267/530] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:48 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:49.923155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:49.923904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.930278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.930770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.931208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.931942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.932399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.932824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.947782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:50.066578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.075280 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.076794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.077953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b87092c7-ca39-4130-832b-d7172b9dd98d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1720 microversion: 2.20 time: 0.158710 Aug 30 16:21:50.078514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 264/531] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:49 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:51.100919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:51.101559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:51.108848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.109409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.109889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.110595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.111057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.111510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.239529 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:51.248002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:51.249444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:51.250593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7110d2eb-bf06-4476-992e-aa5f2243c2ff tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1720 microversion: 2.20 time: 0.153651 Aug 30 16:21:51.251153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 268/532] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:51 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:51.801919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:51.813945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.814488 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.814985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.827674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] Creating event network-vif-unplugged:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:21:51.833143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-07b4193a-3b07-44cf-a6df-61ab2039039d req-72710692-03ca-4c0b-ae03-ea61fdd9fbde service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035038 Aug 30 16:21:51.834076 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 265/533] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:52.273856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:52.274454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:52.281410 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.281885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.282320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.283003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.283483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.283909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.413056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.421182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.422628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.423809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5bbbf2ee-94ab-40ed-b438-3735d9bf04e2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1720 microversion: 2.20 time: 0.153856 Aug 30 16:21:52.424376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 269/534] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:52 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:53.452905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:53.453598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:53.460173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.460661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.461108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.461811 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.462264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.462677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.596182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:53.604518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:53.606028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:53.607187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-712f7cc1-2bc1-4104-afeb-c98d5186f8e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1720 microversion: 2.20 time: 0.159727 Aug 30 16:21:53.607778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 266/535] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:53 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:54.630225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:54.630952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:54.637532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.638018 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.638462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.640085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.640555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.640989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.791601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:54.800425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:54.801899 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:54.803072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87dde4e0-3b59-4153-9b2f-099b166a911b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1723 microversion: 2.20 time: 0.177020 Aug 30 16:21:54.803682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 270/536] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:54 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:54.832237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a79b4666-4e9d-4344-b935-63286d781fa7"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:54.834567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:54.841070 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.841545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.841981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.843281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.843732 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.844151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.144618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9c95f871-7c96-4b0a-a967-d53b511e57c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316443 Aug 30 16:21:55.145344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 267/537] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 30 16:21:54 2022] POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:21:55.267469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:55.268059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:55.273988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.274470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.275005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.275727 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.276180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.276602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.319237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:21:55.386550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2675d645-84d4-4fa5-8402-1bedfed47a7b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/action" status: 202 len: 0 microversion: 2.20 time: 0.123347 Aug 30 16:21:55.387202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 271/538] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 30 16:21:55 2022] POST /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:55.396332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:55.396893 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:55.404399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.405908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.406824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.407097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.407789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.408307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.544296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.553854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.555399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.556661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-340cb124-d7db-4689-8189-e8c400d4e299 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1749 microversion: 2.20 time: 0.164682 Aug 30 16:21:55.557747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 268/539] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:55 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:56.067391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:56.067927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:56.073970 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.074461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.074913 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.075659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.076168 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.076598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.214684 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lazy-loading 'services' on Instance uuid 2859998f-2b64-4274-a3c1-2f0606306a22 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:21:56.333187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-396a4e9a-b2d3-4153-9080-06ca82c48459 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22/os-volume_attachments/673d7bb7-5faf-43c9-a4c5-e44757373f45" status: 202 len: 0 microversion: 2.1 time: 0.270147 Aug 30 16:21:56.333799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 272/540] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:21:56 2022] DELETE /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22/os-volume_attachments/673d7bb7-5faf-43c9-a4c5-e44757373f45 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:56.580110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:56.580718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:56.587139 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.587650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.588380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.589078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.589532 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.589964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.721378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:56.730064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:56.731522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:56.733248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-acacd093-1900-43b3-9314-2317f74cefbd tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1751 microversion: 2.20 time: 0.156490 Aug 30 16:21:56.733800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 269/541] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:56 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:57.460290 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:57.460879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:57.467080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.467797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.468239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.468942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.469401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.469832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.494672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:21:57.528185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:57.573213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b50764bc-a079-4a39-b042-a5c22977c2bb tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 204 len: 0 microversion: 2.1 time: 0.117167 Aug 30 16:21:57.573989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 273/542] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:21:57 2022] DELETE /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:57.582055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:57.582769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:57.589170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.589647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.590078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.590762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.591214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.591661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.733539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.741507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7f1c70b9-8262-44f7-a724-498145036144 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1512 microversion: 2.1 time: 0.163378 Aug 30 16:21:57.742241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 270/543] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:57 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:57.757125 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:57.757820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:57.764102 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.764601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.765011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.765696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.766152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.766571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.905319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.914191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.915669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.916839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae36b3e0-9749-4daa-addd-ab377e693185 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1751 microversion: 2.20 time: 0.164340 Aug 30 16:21:57.917412 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 274/544] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:57 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:58.763192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:58.763810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:58.770846 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.771369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.771810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.772507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.772968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.773394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.900248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:58.907804 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c5e8f52d-fe4a-4bd5-a3b5-4e4fb8c1a580 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1512 microversion: 2.1 time: 0.148544 Aug 30 16:21:58.908407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 271/545] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:58 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:58.940175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:58.940798 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:58.947091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.947632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.948072 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.948763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.949251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.949677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.085187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.094008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.095487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.096649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49b84624-ae0f-4d0f-9d45-c303dd547076 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1751 microversion: 2.20 time: 0.160878 Aug 30 16:21:59.097573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 275/546] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:21:58 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:21:59.928383 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:59.929002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:59.935387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.935879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.936321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.937106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.937553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.937979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.121939 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:00.122797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:00.151801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.151977 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.152363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.152997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.153975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.155253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.155980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.161100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-af494c3c-63a2-48c8-bb37-4035b372f617 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 200 len: 1512 microversion: 2.1 time: 0.236421 Aug 30 16:22:00.161688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 272/547] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:59 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:00.167600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2859998f-2b64-4274-a3c1-2f0606306a22", "name": "network-vif-deleted", "tag": "21208032-0d1d-4e24-a8e3-bf91b58c0c06"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:00.180759 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.181247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.181682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.197828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] Creating event network-vif-deleted:21208032-0d1d-4e24-a8e3-bf91b58c0c06 for instance 2859998f-2b64-4274-a3c1-2f0606306a22 on hv-cinder-85220 Aug 30 16:22:00.204095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-566657f4-2e17-4a03-86b7-15c6e660b6ea req-b539c41e-55b2-4d79-847d-06c632ec8631 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040650 Aug 30 16:22:00.205266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 273/548] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:00.617016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.628985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.630490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.631773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7974ea72-5681-47da-bfd0-bb76cb149d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.514351 Aug 30 16:22:00.632330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 276/549] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:00 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:01.182990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:01.183791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: 2859998f-2b64-4274-a3c1-2f0606306a22] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:01.191823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.192311 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.192749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.193543 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.194419 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.194584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.208269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] HTTP exception thrown: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Request method failure captured: Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 HTTP/1.1 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjjcbhtI5zkVWEFthPZGy9XIUZWGSl8ipe8o26Gmrcx6KJBI-62xtGbyhHvGOmTQn7YAfnx4LrqE8zGdP16-tMIuQsG6rez85OO1GOUUoEva6p_PMgAJqiMda4JLEra4bpFzvUOGExWzphvHG8WlHM1uZezhledv0GujWFMKIzWw17A Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 80405e8d445d49199ed0d9ccd014dfb7 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:22:01.209918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80405e8d445d49199ed0d9ccd014dfb7"}]}] Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 80405e8d445d49199ed0d9ccd014dfb7 Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotTestJSON-1109699214-project Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 651091dd88274d2cb0b5b7afc0a18e5e Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotTestJSON-1109699214-project Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. Aug 30 16:22:01.211416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '2859998f-2b64-4274-a3c1-2f0606306a22'} Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:01.212205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. Aug 30 16:22:01.213461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:22:01.215003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Returning 404 to user: Instance 2859998f-2b64-4274-a3c1-2f0606306a22 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:01.215003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-69a8c006-767e-4333-892a-ceb4f7822ca0 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22" status: 404 len: 111 microversion: 2.1 time: 0.032948 Aug 30 16:22:01.215003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 274/550] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:01 2022] GET /compute/v2.1/servers/2859998f-2b64-4274-a3c1-2f0606306a22 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:01.656597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:01.657794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:01.664984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.665749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.666353 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.667264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.667892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.668505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.817146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:01.826017 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:01.827556 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:01.828726 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e8a4db4-dde0-49df-bbfc-1a4369524dce tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.178675 Aug 30 16:22:01.829295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 277/551] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:01 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:02.852033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:02.852553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:02.859530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.860299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.860740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:02.861462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.861924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.862344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.053459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:03.063141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:03.064605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:03.065883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-78132dea-954d-4698-82d4-7ff381135f17 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.217751 Aug 30 16:22:03.066610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 275/552] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:02 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:04.093263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:04.094618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:04.109034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.110237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.111268 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.112793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.114107 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.115193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.375019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.388147 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.390212 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.391663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9797b824-9881-4686-b644-94626c3781d4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.305618 Aug 30 16:22:04.392642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 278/553] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:04 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:05.423910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:05.425227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:05.431529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.432020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.432448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.433148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.433597 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.434159 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.612614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:05.640660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:05.640660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:05.640660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e36eb565-81b7-449a-b6fd-62ebbf617974 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.223966 Aug 30 16:22:05.649317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 276/554] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:05 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:06.658568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:06.659177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:06.665750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.666241 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.666741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.667805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.668395 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.669052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.807259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:06.816973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:06.818346 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:06.819666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d997edb8-5129-497d-bd18-4d8b1a41a538 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.164944 Aug 30 16:22:06.820251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 279/555] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:06 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:07.843867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:07.844481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:07.851313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.851809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.852244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.853030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.853491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.854006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.057388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.072031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.073551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.074708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-dfb1cd10-6027-4789-bdef-8226b897fbd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.235497 Aug 30 16:22:08.075299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 277/556] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:07 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:09.098989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:09.099793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:09.109488 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.109986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.110444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.111316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.111824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.112546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.280876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:09.291409 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:09.293016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:09.294302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02fa7673-cbca-4706-9c71-213a769c3e48 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.199979 Aug 30 16:22:09.298813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 280/557] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:09 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:10.319075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:10.320651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:10.328622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.329236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.329738 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.330449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.330903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.331348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.479137 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:10.492713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:10.494691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:10.496101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d35afc11-dbad-4e19-b80c-77dc83299067 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.182103 Aug 30 16:22:10.497197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 278/558] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:10 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:11.518496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:11.519314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:11.521529 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:11.526952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.527472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.527907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.528605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.529101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.529561 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.707593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.717222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.718983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.720198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0fadf92-e3a9-4f6a-851e-6ad13de35783 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.205559 Aug 30 16:22:11.720763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 281/559] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:11 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:12.743539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:12.744226 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:12.746715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=40 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:12.752708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.753452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.754062 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:12.754708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.755168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.755626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:12.887378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:12.896949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:12.898972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:12.900120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0d34dff9-e2f0-4727-9e57-0eb252874dc2 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.160541 Aug 30 16:22:12.900685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 279/560] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:12 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:13.923195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:13.923825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:13.929886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:13.930368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:13.930807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:13.931532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:13.931985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:13.932419 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.059589 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:14.070348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:14.072144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:14.073336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d83e57e-3831-4484-b46f-6e07a3ba05ae tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.154069 Aug 30 16:22:14.073897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 282/561] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:13 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:15.229489 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:15.230098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:15.236089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.236568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.237000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.237688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.238141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.238559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.256241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:15.390473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:15.400091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:15.401569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:15.402751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-319e95c9-b299-46b9-930f-923892f02773 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.310923 Aug 30 16:22:15.403339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 280/562] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:15 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:16.428691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:16.429297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:16.435723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.436210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.436651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.437347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.437808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.438235 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.571882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:16.580878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:16.582383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:16.583595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf07a15d-2d2a-4654-bf4e-3957131feb76 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.158787 Aug 30 16:22:16.584159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 283/563] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:16 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:17.383655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2088689810", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "networks": [{"uuid": "8d4d449b-0365-4529-bd8e-b94bfbf39766"}]}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:17.436621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] validate_networks() for [('8d4d449b-0365-4529-bd8e-b94bfbf39766', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:17.484536 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:22:17.484791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Tue Aug 30 16:22:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.57) !!! Aug 30 16:22:17.606719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.607386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:17.614415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.614915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.615391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.616091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.616553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.616984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.748960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:17.758296 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:17.759776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:17.761046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7126fe0-6c45-4031-942a-a48ef8e15820 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.158288 Aug 30 16:22:17.775246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 284/564] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:17.799400 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:17.799882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:17.800364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:17.800777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:17.801194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:17.810004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.810537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.811015 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.811875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.812366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.812829 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.830716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Getting quotas for project 80405e8d445d49199ed0d9ccd014dfb7. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:17.834611 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Getting quotas for user 651091dd88274d2cb0b5b7afc0a18e5e and project 80405e8d445d49199ed0d9ccd014dfb7. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:17.846316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:17.848793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:17.896485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d672a64c-1df0-4170-8969-a5b4ea8a4ff9 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516632 Aug 30 16:22:17.897322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 281/565] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:22:17.908826 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a66b1ca-9bf0-42b9-b6d2-af12372d912b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.909479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a66b1ca-9bf0-42b9-b6d2-af12372d912b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:17.965626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a66b1ca-9bf0-42b9-b6d2-af12372d912b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:17.973097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a66b1ca-9bf0-42b9-b6d2-af12372d912b tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1219 microversion: 2.1 time: 0.068616 Aug 30 16:22:17.973689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 285/566] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:18.785857 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:18.786493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:18.792481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.792959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.793388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.794064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.794524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.794937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.924773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.933264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.934698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.935878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b9ab529f-7964-4618-8095-ca4ea2108598 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.154480 Aug 30 16:22:18.936435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 282/567] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:18 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:18.995745 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:18.996428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:19.004201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.004682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.005117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.005812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.006443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.006865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.071953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:19.079612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e314cf7a-68a5-40bd-8c6a-ce9ee2e4ebd3 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1223 microversion: 2.1 time: 0.087840 Aug 30 16:22:19.080177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 286/568] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:18 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:19.959840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:19.960613 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:19.968403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.969084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.969575 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.971432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.971906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.972340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.100333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:20.100781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:20.107569 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.108067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.108514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.109425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.109889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.111751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.114121 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.123855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.125322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.126976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-804f4fd3-64d2-441f-b190-8edbaa7fd243 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.171698 Aug 30 16:22:20.127777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 283/569] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:19 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:20.178622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.186661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4070f2fd-060b-496a-8de5-dbb491e2fcd1 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1215 microversion: 2.1 time: 0.090542 Aug 30 16:22:20.187253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 287/570] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:20 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:21.151403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:21.152046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:21.159156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.159678 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.160147 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.160907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.161335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.161784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.211258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:21.212530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:21.221153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.221932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.222550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.223466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.224095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.224686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.308304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.318002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.325725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00e5d4ab-e97a-4b86-af0c-77ec00d0840e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1279 microversion: 2.1 time: 0.120633 Aug 30 16:22:21.326697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 288/571] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:21 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:21.342510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.344411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.346200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6f7f4349-ce59-426c-b7da-579afb021189 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.198721 Aug 30 16:22:21.346757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 284/572] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:21 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:22.351606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.352229 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:22.358935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.359473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.359918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.360662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.361121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.361637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.369592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.370609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:22.378284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.385105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.385742 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.386477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.386960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.387411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.522624 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.531426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.533602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.534775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b9e1454c-002b-43d7-8c72-f5d813a24efe tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.169096 Aug 30 16:22:22.535372 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 285/573] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:22 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:22.556599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.564492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c430caa9-2bab-4429-a5cc-5fec04818de7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.216832 Aug 30 16:22:22.565006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 289/574] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:22 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:22.614086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae13efaf-0d44-4967-8d75-b283f6798662", "tag": "2034c915-c30d-4fc4-8636-a48f693f67b7"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:22.623639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.624119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.624543 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.638580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] Creating event network-changed:2034c915-c30d-4fc4-8636-a48f693f67b7 for instance ae13efaf-0d44-4967-8d75-b283f6798662 on hv-cinder-85220 Aug 30 16:22:22.645066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-b10ced13-598d-44cc-8618-aba2fea9e544 req-35e76dcc-d063-4252-b891-86835d4329d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034629 Aug 30 16:22:22.646212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 286/575] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:23.558401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:23.559022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:23.566667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.567158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.567635 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.568343 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.568809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.569236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.584775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:23.585479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:23.592254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.592745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.593181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.593880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.594359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.594783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.701581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:23.703825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:23.712440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:23.714253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:23.715481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f5908c4-1c6a-41f5-bd98-e29499c692ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.161348 Aug 30 16:22:23.716380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 290/576] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:23 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:23.731336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:23.739679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-35d266f1-5111-4ead-a482-7a5c884ac066 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.159117 Aug 30 16:22:23.740251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 287/577] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:23 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:24.738759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:24.739533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:24.746412 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.746901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.747385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.748086 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.748553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.748983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.760348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:24.760965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:24.767885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.768377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.768822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.769523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.769984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.770416 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.882433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:24.891425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:24.892893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:24.894110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99e41114-7327-4b4c-b8b0-458ee990dc00 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.159952 Aug 30 16:22:24.894672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 291/578] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:24 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:24.903328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:24.910991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-543082b4-04ea-4888-9110-a214cb31ab13 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.154482 Aug 30 16:22:24.911594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 288/579] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:24 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:25.917644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:25.918245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:25.924792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:25.925277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:25.925708 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:25.926403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:25.926858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:25.927306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:25.931873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:25.932565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:25.938955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:25.939472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:25.939902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:25.940600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:25.941068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:25.941482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:26.074748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:26.088754 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:26.089480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:26.090698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:26.092545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-283fd978-57cd-4363-a395-8257545bdf9e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.178632 Aug 30 16:22:26.093433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 292/580] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:25 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:26.097486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2ecb83aa-9931-452d-8cb8-233c48ffbdce tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.169393 Aug 30 16:22:26.098057 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 289/581] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:25 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:27.116024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:27.116735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:27.117903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:27.118519 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:27.118882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:22:27.119034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Tue Aug 30 16:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac (ip 10.222.0.57) !!! Aug 30 16:22:27.127021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.127518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.128237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.128951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.129406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.129841 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.130031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.131548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.131996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.132715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.133180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.133629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.262557 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:27.268533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:27.271201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1757bc58-bae4-42d6-8e86-f16f8f255847 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.157142 Aug 30 16:22:27.271841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 290/582] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:27 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:27.277533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:27.279140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:27.280433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28014ce7-a514-47a7-957e-c38b5133324a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.168406 Aug 30 16:22:27.281101 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 293/583] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:27 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:28.291464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:28.292073 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:28.294003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.294649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.302202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.302699 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.303141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.303886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.304365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.304813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.304923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:28.305576 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:28.307547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.313310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.313807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.314265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.314962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.315456 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.315890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.453200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:28.461566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b657a0e9-5790-45b4-beef-c9595b428a41 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.173751 Aug 30 16:22:28.462124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 291/584] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:28 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:28.554000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:28.564637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:28.566267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:28.567556 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-256aa2d3-e0da-4cb7-bd61-d11a36919040 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.267058 Aug 30 16:22:28.568241 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 294/585] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:28 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:29.482813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.483486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.490282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.490771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.491212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.491947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.492409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.492837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.598586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.599266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.606007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.606502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.606947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.607910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.608236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.608671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.634409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.643351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a16f99f9-6ee5-43f7-a758-ef63e0310cac tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.163879 Aug 30 16:22:29.643351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 292/586] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:29.741563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.750310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.752442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.753940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-188bc200-1603-47bc-900a-03b3aa604baf tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.159947 Aug 30 16:22:29.754501 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 295/587] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:30.195240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae13efaf-0d44-4967-8d75-b283f6798662", "name": "network-vif-plugged", "status": "completed", "tag": "2034c915-c30d-4fc4-8636-a48f693f67b7"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:30.205137 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.205621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.206057 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.220210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] Creating event network-vif-plugged:2034c915-c30d-4fc4-8636-a48f693f67b7 for instance ae13efaf-0d44-4967-8d75-b283f6798662 on hv-cinder-85220 Aug 30 16:22:30.225680 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-c359347b-1bea-409f-bcb6-204efb1b0258 req-752bb24b-cf98-4d93-bcfc-5fd79412d627 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034094 Aug 30 16:22:30.226286 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 293/588] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:30.664095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:30.664712 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:30.671137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.671686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.672124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.673414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.673906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.674364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.778764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:30.779487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:30.787159 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.788054 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.788797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.789655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.790205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.790973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.813362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.821012 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5742453b-b864-4c74-bcf2-0001ef3991aa tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.160834 Aug 30 16:22:30.821591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 296/589] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:30 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:30.950791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.960632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.962091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.963296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-addd2d3b-4207-47bf-948e-a9ac467d6863 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.189168 Aug 30 16:22:30.963871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 294/590] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:30 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:31.841274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.841986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.849218 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.849735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.850181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.850877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.851379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.851831 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.984503 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:31.987736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.988448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.993323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b62f648f-834f-40e0-bba1-61ec985e26dc tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1319 microversion: 2.1 time: 0.156118 Aug 30 16:22:31.993929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 297/591] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:31.995121 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.995689 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.996311 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.997095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.997576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.998003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.132891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.141575 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.143030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.144228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-55b5fd93-652e-4525-9184-eabdcb3c0392 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.161817 Aug 30 16:22:32.144796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 295/592] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:22:32.279937 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "name": "network-vif-plugged", "status": "completed", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:32.290428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.291239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.291686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.304858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] Creating event network-vif-plugged:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:22:32.310244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6e72bd47-bfa4-4dc0-b5d3-9adc8b744015 req-6e6db122-ea9d-4053-8448-c88987f8af95 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 Aug 30 16:22:32.311440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 298/593] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:33.017579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:33.018202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.025152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.025630 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.026058 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.026740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.027250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.027743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.160023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.168023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:33.168710 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-46e8e4c1-1581-441d-b452-093729a3970d tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1507 microversion: 2.1 time: 0.156442 Aug 30 16:22:33.168924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.169305 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 296/594] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:33 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:33.176351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.176864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.177335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.178030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.178485 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.178912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.189769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67b959c5-51b0-4da8-bf67-9f763ea11036", "device": "/dev/sdb"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:33.192734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.198914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.199456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.199898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.200606 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.201063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.201490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.321903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.332592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.334436 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.335937 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f49b41a8-bc67-4c77-9187-39ae80c0f706 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.172834 Aug 30 16:22:33.336446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 299/595] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:33 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:33.466207 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:33.478439 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9e982ce7-02c9-4fdb-b7fe-e22fd13af3ed tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "POST /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292522 Aug 30 16:22:33.479068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 297/596] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:22:33 2022] POST /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:22:34.358969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:34.359628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:34.366954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.367490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.367985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.368747 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.369282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.369714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.513898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:34.523578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:34.525028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:34.526225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03542fa5-73f4-440d-8a06-3a310a4de342 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.171401 Aug 30 16:22:34.526780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 300/597] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:34 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:35.551403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:35.552073 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:35.559392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.559900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.560356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.561369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.561841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.562326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.709028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.718208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.720188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.721388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a5687708-56e2-4e57-919d-bb8c391d8576 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1807 microversion: 2.20 time: 0.175329 Aug 30 16:22:35.721962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 298/598] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:35 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:36.744703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:36.745299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:36.751718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.752199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.752633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.753983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.754448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.754866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.882879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:36.892792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:36.893609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:36.894775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5a1b8f1-14dd-40b1-b1e0-47675d37a63c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1794 microversion: 2.20 time: 0.153893 Aug 30 16:22:36.895359 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 301/599] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:36 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:52.910135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:52.912459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:52.915281 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.915957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.922444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.922928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.923405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.924107 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.924566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.924995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.998117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6090171d-b7ed-4e23-a68f-0149d034b6bd tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action" status: 202 len: 0 microversion: 2.1 time: 0.091778 Aug 30 16:22:52.998983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 299/600] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:52 2022] POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:53.007426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.008051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:53.010262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=43 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.011337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=63 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.016885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.017388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.017845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.018552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.019013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.019541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.168467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:53.177641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22a8a111-448f-4761-9299-623e6d3958a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1748 microversion: 2.1 time: 0.174507 Aug 30 16:22:53.178221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 302/601] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:53 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1748 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:54.200105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:54.200954 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:54.207488 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.207974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.208403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.209098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.209544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.209973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.375043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:54.383555 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d11ce56b-8e7a-4f00-9f33-4322f4980b09 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.188297 Aug 30 16:22:54.384119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 300/602] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:54 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:55.406431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:55.407052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:55.413819 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.414381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.414915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:55.415927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.416394 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.416829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:55.561951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:55.570469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca5e140c-78f3-4e38-854d-fc9c244f7504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.168564 Aug 30 16:22:55.571038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 303/603] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:55 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:56.592393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:56.593043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:56.600098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:56.600584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:56.601051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.601752 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:56.602207 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:56.602635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.754067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:56.762380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6680b2d5-2763-46a5-857e-53c48e21540c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.173857 Aug 30 16:22:56.762957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 301/604] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:56 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:57.784639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.785244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:57.791618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.792103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.792533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.793222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.793674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.794104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.936668 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:57.944889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd465f43-3d18-4478-bde4-a2c48d049f39 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.164618 Aug 30 16:22:57.945486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 304/605] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:57 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:58.040494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:58.040999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:58.047381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.047871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.048312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.049009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.049468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.049890 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.177110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lazy-loading 'services' on Instance uuid ae13efaf-0d44-4967-8d75-b283f6798662 {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:22:58.292254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e09a3acb-24d8-45cb-9695-a1dc7867d95e tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662/os-volume_attachments/67b959c5-51b0-4da8-bf67-9f763ea11036" status: 202 len: 0 microversion: 2.1 time: 0.256348 Aug 30 16:22:58.292865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 302/606] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:22:58 2022] DELETE /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662/os-volume_attachments/67b959c5-51b0-4da8-bf67-9f763ea11036 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:58.966285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:58.966904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:58.976457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.976952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.977398 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.978128 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.978591 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.979024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.137536 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.145875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93f53e6e-4542-4e9e-b99c-1972c96ed504 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.183789 Aug 30 16:22:59.146799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 305/607] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:58 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:59.412289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:59.412965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:59.419134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.419660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.420103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.420825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.421321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.421876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.446574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:22:59.533905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bb8db1ca-1497-45b0-bd3f-ad8bab508736 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 204 len: 0 microversion: 2.1 time: 0.125999 Aug 30 16:22:59.534451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 303/608] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:59 2022] DELETE /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:59.543994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:59.544605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:59.550907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.551451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.551882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.552559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.553012 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.553434 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.689697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.698341 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-544dea89-13aa-42c3-9953-02546b82b458 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1513 microversion: 2.1 time: 0.159465 Aug 30 16:22:59.698913 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 306/609] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:59 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:00.169322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:00.170022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:00.176422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.176900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.177336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.178023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.178478 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.178902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.321976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.330236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-93f41b06-ea6e-48dd-ae83-3d27f2687f98 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.165178 Aug 30 16:23:00.330810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 304/610] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:00 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:00.720590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:00.721210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:00.727856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.728195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.728568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.729270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.729735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.730168 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.860688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.868719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32237ce2-6d62-43e2-9509-b78f490a9f72 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1513 microversion: 2.1 time: 0.152554 Aug 30 16:23:00.869300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 307/611] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:00 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:01.351633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:01.352274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:01.358710 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.359816 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.360260 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.360959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.361417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.361842 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.502918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:01.511412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-602a96e2-29b2-4ef1-a50d-c8b963b427a2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.163603 Aug 30 16:23:01.512011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 305/612] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:01 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:01.890761 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:01.891418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:01.898084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.898574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.899043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.899804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.900309 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.900792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.343658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.351415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f523ffd7-09b3-4879-8085-6abc719155d7 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1513 microversion: 2.1 time: 0.464966 Aug 30 16:23:02.352052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 308/613] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:01 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:02.532252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:02.532823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:02.539713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.539881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.540259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.540972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.541433 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.541860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.704494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.713690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-684e6d9b-f220-4116-9986-af288be154b5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.185453 Aug 30 16:23:02.714272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 306/614] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:02 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:02.789157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae13efaf-0d44-4967-8d75-b283f6798662", "name": "network-vif-deleted", "tag": "2034c915-c30d-4fc4-8636-a48f693f67b7"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:02.799491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.800024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.800402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.812889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] Creating event network-vif-deleted:2034c915-c30d-4fc4-8636-a48f693f67b7 for instance ae13efaf-0d44-4967-8d75-b283f6798662 on hv-cinder-85220 Aug 30 16:23:02.817910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ddee3f63-8c13-4d14-9ba8-6ab238c90c9b req-0c382781-4a30-465e-a5eb-81e615a28e52 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093145 Aug 30 16:23:02.818546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 309/615] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:03.373663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.374297 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:03.381227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.381708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.382146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.382833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.383312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.383737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.416455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.416945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.417380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.417827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lazy-loading 'fault' on Instance uuid ae13efaf-0d44-4967-8d75-b283f6798662 {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:03.464801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '651091dd88274d2cb0b5b7afc0a18e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80405e8d445d49199ed0d9ccd014dfb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:03.473205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d39dc8d5-73c6-436b-82cd-c057be9da290 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 200 len: 1309 microversion: 2.1 time: 0.103427 Aug 30 16:23:03.473792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 307/616] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:03.738160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.738860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:03.745259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.745749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.746195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.746967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.747601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.748091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.894393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:03.902621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92f2be7e-3808-4b5d-8669-dc36ea9194a4 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.169855 Aug 30 16:23:03.903122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 310/617] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:04.496168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:04.496773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] [instance: ae13efaf-0d44-4967-8d75-b283f6798662] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:04.504046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.504541 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.504981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:04.505679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.506143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.506567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:04.520813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] HTTP exception thrown: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Request method failure captured: Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 HTTP/1.1 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjjcbhtI5zkVWEFthPZGy9XIUZWGSl8ipe8o26Gmrcx6KJBI-62xtGbyhHvGOmTQn7YAfnx4LrqE8zGdP16-tMIuQsG6rez85OO1GOUUoEva6p_PMgAJqiMda4JLEra4bpFzvUOGExWzphvHG8WlHM1uZezhledv0GujWFMKIzWw17A Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 80405e8d445d49199ed0d9ccd014dfb7 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:23:04.522604 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80405e8d445d49199ed0d9ccd014dfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/80405e8d445d49199ed0d9ccd014dfb7"}]}] Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 80405e8d445d49199ed0d9ccd014dfb7 Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1109699214 Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesSnapshotTestJSON-1109699214-project Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 651091dd88274d2cb0b5b7afc0a18e5e Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesSnapshotTestJSON-1109699214-project Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. Aug 30 16:23:04.524241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'ae13efaf-0d44-4967-8d75-b283f6798662'} Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:04.525129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. Aug 30 16:23:04.526652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:04.528023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] Returning 404 to user: Instance ae13efaf-0d44-4967-8d75-b283f6798662 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:04.528023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c93049cb-3579-4341-b52c-d01df0327872 tempest-VolumesSnapshotTestJSON-1109699214 tempest-VolumesSnapshotTestJSON-1109699214-project] 10.222.0.57 "GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662" status: 404 len: 111 microversion: 2.1 time: 0.031863 Aug 30 16:23:04.528023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 308/618] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:04 2022] GET /compute/v2.1/servers/ae13efaf-0d44-4967-8d75-b283f6798662 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:04.924982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:04.925531 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:04.934153 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.934923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.935588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:04.936628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.937979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.938628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.097020 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.105352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b30284f2-86e3-4cac-aab0-66736c15193e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.185055 Aug 30 16:23:05.105924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 311/619] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:04 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:06.127375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:06.127923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:06.134571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.135054 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.135532 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.136233 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.136691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.137120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.280283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:06.289119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f2a3a592-e902-445d-9fa7-47180fcf303d tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.165957 Aug 30 16:23:06.289693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 309/620] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:06 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:07.310243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:07.310768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:07.317467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.317982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.318451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:07.319159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.319651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.320080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:07.464253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:07.473251 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4e94e45-177d-4d91-9eed-72abaf605e4c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.167032 Aug 30 16:23:07.473832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 312/621] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:07 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:08.494155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:08.494805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:08.501486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:08.501966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:08.502403 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:08.503100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:08.503848 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:08.504274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:08.650229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:08.658955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-60a7e9df-1e7f-4a58-b97a-7fd90e07ae7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.168945 Aug 30 16:23:08.659559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 310/622] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:08 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:09.680013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:09.680616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:09.687347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:09.687843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:09.688288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:09.688998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:09.689463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:09.689898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:09.839303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:09.848255 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea2f3bac-e1a8-44cd-bbbb-a5c062d2cc7a tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.172128 Aug 30 16:23:09.848840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 313/623] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:09 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:10.869698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:10.870346 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:10.877838 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.878600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.879038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.879840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.880375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.880755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:11.024304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:11.032983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-34b4360a-79ad-4bfc-af06-0a77cfbf668b tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.167151 Aug 30 16:23:11.033552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 311/624] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:10 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:12.056201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.056819 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:12.063901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.064384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.064821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.065510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.065965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.066393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.214037 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:12.222451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0ec2223-b508-4a0d-8a64-f8c558195ad0 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.170079 Aug 30 16:23:12.223039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 314/625] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:12 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:13.243302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:13.243916 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:13.251020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.251550 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.251990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.252704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.253151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.253828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.273318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:13.403274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:13.411977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bfcd64a0-9a65-4b1b-8bdb-96968d31152e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.172578 Aug 30 16:23:13.412548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 312/626] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:13 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:14.432786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:14.433402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:14.440294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.440781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.441221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.441924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.442384 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.442815 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.588842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:14.597476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-143a5ac9-2097-4923-b598-bf93c30979d3 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.168622 Aug 30 16:23:14.598051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 315/627] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:14 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:15.619389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:15.619995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:15.626237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.626720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.627158 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.627866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.628599 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.629014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.772249 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.780646 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-974c5c86-21c2-43a4-8f90-4de9c86ca223 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.165339 Aug 30 16:23:15.781713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 313/628] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:15 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:16.802710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:16.803337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:16.809987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.810468 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.810947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:16.811704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.812179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.812621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:16.957287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:16.965598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16530792-fd21-465b-97ac-e62f3fd237e9 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.166728 Aug 30 16:23:16.966181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 316/629] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:16 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:17.879413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5c65d4e-2c74-4da0-b0c0-31b70fa5b854"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:17.881826 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:17.887984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.888474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.888911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.889612 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.890074 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.890503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.987524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:17.988137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:17.994461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.994948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.995433 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.996136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.996595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.997026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:18.150036 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:18.158934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a007fa0d-51dc-47a4-80d4-1df850f9ccd5 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.175912 Aug 30 16:23:18.159560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 317/630] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:17 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:19.180197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:19.180816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:19.187867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.188361 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.188806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:19.189508 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.189969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.190404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:19.335639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:19.344057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32ee20f3-23a6-437d-98c6-1444ece5dc28 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1753 microversion: 2.1 time: 0.167717 Aug 30 16:23:19.344912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 318/631] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:19 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:19.961945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-278d3d4a-126b-44d5-bb68-d71a38ec91c2 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.184226 Aug 30 16:23:19.963355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 314/632] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:23:17 2022] POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments => generated 194 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:20.383016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:20.383701 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:20.390581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:20.391083 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:20.391557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:20.392275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:20.392732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:20.393166 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:20.398027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:20.593661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:20.603298 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b975d662-dc8e-47bb-9f42-4539073e3f12 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1756 microversion: 2.1 time: 0.235089 Aug 30 16:23:20.603880 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 319/633] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:20 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:27.507958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:27.510303 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:27.512390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:27.517903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.518908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.519378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.520086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.520541 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.521057 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.546334 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lazy-loading 'flavor' on Instance uuid 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:27.679936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-45f340fa-3909-4869-bee8-a8d825e30353 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/action" status: 200 len: 32 microversion: 2.1 time: 0.177275 Aug 30 16:23:27.680557 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 315/634] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:27 2022] POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:23:27.690285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:27.690903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:27.694223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=37 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:27.701578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.702296 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.702785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.703563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.704033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.704471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.947907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:27.957207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8ba874c-feda-43c1-9e29-2dde20dc3d86 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.270730 Aug 30 16:23:27.957802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 320/635] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:27 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:28.446906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.447535 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:28.454352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.454836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.455302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.456001 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.456459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.456888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.542384 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lazy-loading 'services' on Instance uuid 70cd69f5-b796-45fb-a89f-d7d39864d2ae {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:28.613140 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8c7d91c0-b448-4627-8425-afb43cd9f04c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments/ab128659-20b3-4248-837c-483ee7d1aa89" status: 202 len: 0 microversion: 2.1 time: 0.273634 Aug 30 16:23:28.613763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 316/636] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:23:28 2022] DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments/ab128659-20b3-4248-837c-483ee7d1aa89 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:28.978156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.978766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:28.985998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.986491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.986912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.987644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.988085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.988507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.117385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:29.125645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7619b213-5b00-446d-8001-9537919ef6e8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.151322 Aug 30 16:23:29.126221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 321/637] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:28 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:29.733595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:29.740487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.741019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.741479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.763470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Going to try to stop instance {{(pid=120589) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:23:29.810006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-44593f9c-0d07-4b25-9103-11fe520ea217 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.080882 Aug 30 16:23:29.810621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 317/638] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:29 2022] POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:29.818613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:29.819352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:29.825413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.825991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.826430 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.827132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.827829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.828262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.961380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:29.969868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2fd0cdc-a11e-4634-821d-7eeaa7e4ac73 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.155007 Aug 30 16:23:29.970634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 322/639] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:29 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:30.150208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:30.151622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:30.158823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.159341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.159787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.160529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.160992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.161421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.298651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.306874 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-71e201fd-3696-43f2-9973-2e63d778c93c tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.161994 Aug 30 16:23:30.307488 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 318/640] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:30 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:30.991446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:30.991989 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:30.998963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.999513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.999964 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.000700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.001174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.001607 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.141464 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.149292 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96257e22-622b-49e1-8189-af5db572d5c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.162086 Aug 30 16:23:31.150471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 323/641] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:30 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:31.329097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.329932 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:31.336741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.337220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.337697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.338472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.338955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.339426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.468994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.477287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f3a0b3f8-0e95-4aaf-8a86-fca3ce61f602 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.152747 Aug 30 16:23:31.477876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 319/642] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:32.171065 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.171722 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.178779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.179307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.179753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.180454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.180913 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.181345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.312527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:32.320976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83b794a2-2897-469b-af3e-dfd56d95e25e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.153831 Aug 30 16:23:32.321568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 324/643] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:32.498218 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.498776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.506220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.506698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.507134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.507861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.508309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.508735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.640290 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:32.648701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8b937d10-f027-4094-a565-59d44b103738 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.154362 Aug 30 16:23:32.649271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 320/644] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:33.342203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:33.342815 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:33.349999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.350491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.350935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.351673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.352135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.352568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.488974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:33.496842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d4a8f2d-e758-40c7-b8e2-64ae18aebd08 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.158537 Aug 30 16:23:33.497421 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 325/645] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:33 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:33.670021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:33.670633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:33.677089 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.677550 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.677991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.678757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.679147 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.679609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.808456 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:33.817229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-58d32df8-5e82-45d8-a11a-addb18ec37fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.151192 Aug 30 16:23:33.817807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 321/646] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:33 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:34.518448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:34.519075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:34.525667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.526179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.526613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.527342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.527800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.528226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.656471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.664129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21758a89-d0d2-46e7-ae4b-7977ae60d7a6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.150124 Aug 30 16:23:34.664690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 326/647] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:34 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:34.837434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:34.837981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:34.844940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.845429 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.845869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.846568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.847030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.847483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.975151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.983498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bb72cc0e-f7be-4847-881c-e2533cd4add8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.149901 Aug 30 16:23:34.984088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 322/648] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:34 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:35.685796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:35.686399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:35.692867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.693348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.693780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.694467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.694920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.695367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.833572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:35.842006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73e88ab5-dc59-41ad-8354-c01a831a45b8 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.160061 Aug 30 16:23:35.842621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 327/649] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:35 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:36.006784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.007430 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:36.013758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.014245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.014682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.015402 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.015859 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.016951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.156169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:36.164451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-43b0b80a-63f6-4c52-bb38-f080ba746da7 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.161824 Aug 30 16:23:36.165032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 323/650] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:36 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:36.863826 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.864462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:36.871028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.871528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.871963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.872646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.873098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.873547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.005673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.013473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7284cd8-8d61-42e4-a354-10bed24dc492 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.154153 Aug 30 16:23:37.014044 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 328/651] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:36 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:37.186043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:37.186647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:37.193593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.193999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.194428 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.195132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.195589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.196005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.200126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:37.327420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.335784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-04aa251e-3fa6-4448-a106-450a3bd7276e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.153628 Aug 30 16:23:37.336357 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 324/652] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:37 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:38.035856 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:38.036506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:38.043358 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.043859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.044303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.045008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.045472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.045940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.197757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:38.206357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b870ab0d-ef5e-43e7-9f92-9e8881c93cf6 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.174321 Aug 30 16:23:38.206939 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 329/653] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:38 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:38.357417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:38.357960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:38.364735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.365299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.365696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.366401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.366860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.367316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.506187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:38.515777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-37c935b8-66d5-40c8-80f1-3593b7457637 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.162299 Aug 30 16:23:38.516886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 325/654] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:38 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:39.228963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:39.230360 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.237344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.237833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.238273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.238966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.239454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.239880 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.388882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.397123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23136991-0710-48f8-8ff5-e455941ca23f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.172583 Aug 30 16:23:39.397705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 330/655] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:39 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:39.538513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:39.539129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.545544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.546068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.546498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.547863 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.548329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.548763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.693566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.702526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d452194b-6df5-477e-9555-af3a41bfc209 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.167883 Aug 30 16:23:39.703092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 326/656] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:39 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:40.420829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.421452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.428827 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.429320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.429764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.430464 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.430957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.431435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.580546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.588649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eed874d8-70e8-40e4-9ad1-672c0afc3bad tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.171653 Aug 30 16:23:40.589223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 331/657] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:40.726293 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.727047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.733371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.733900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.734313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.735020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.735524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.735942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.864824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.873092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bd9e8ab8-b02e-4dc2-acca-9c58d2c3648a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.150774 Aug 30 16:23:40.873660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 327/658] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:41.609892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:41.610956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:41.617533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.618026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.618469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.619173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.619663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.620095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.758018 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.765817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77fa1677-3542-473f-a65a-ae3ee2e12058 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.159821 Aug 30 16:23:41.766410 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 332/659] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:41 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:41.894993 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:41.895614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:41.902501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.903066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.903685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.904631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.905218 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.905726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.042435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.050734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6fe6cce8-57c0-4ecb-9644-dd0055b8e939 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.159790 Aug 30 16:23:42.051511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 328/660] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:41 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:42.788704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:42.789315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:42.795520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.796015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.796461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.797164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.797625 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.798590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.942831 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.950619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34e8123d-23ff-4df7-b301-212b9d59e06f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.165864 Aug 30 16:23:42.951273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 333/661] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:42 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:43.071814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:43.072445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:43.079291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.079781 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.080734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.081432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.081886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.082304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.214474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:43.223523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-96326c68-5806-4a80-b26d-71f178df9437 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.155470 Aug 30 16:23:43.224103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 329/662] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:43 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:43.972005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:43.972613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:43.979180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.979660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.980133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.980782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.981232 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.981661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.118138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.126221 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1389c674-3f55-460d-b6e3-2a757486641a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.158084 Aug 30 16:23:44.126796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 334/663] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:43 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:44.245252 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:44.245776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:44.252665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:44.253149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:44.253853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.254574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:44.255033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:44.255485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.388614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.397359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-eb899cc5-2f58-4cc1-8b19-7ab53c86b899 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.156111 Aug 30 16:23:44.397925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 330/664] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:44 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:45.148112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.148732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:45.155530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.156026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.156470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.157802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.158274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.158707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.289637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:45.293002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:45.298089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f135415e-9543-4b6a-b4d3-8d002bfb1009 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1679 microversion: 2.1 time: 0.153820 Aug 30 16:23:45.298663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 335/665] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:45.418012 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.418661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:45.426002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.426685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.427382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.428205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.429033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.429517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.579285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:45.589743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5450499b-6185-4852-916d-f510489d0c7b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.175374 Aug 30 16:23:45.590895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 331/666] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:46.319612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:46.320344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:46.326465 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.326942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.327415 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.328099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.329198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.329621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.471669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.479522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8161d47a-23b9-46c5-bbf7-2874c4d0722b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1656 microversion: 2.1 time: 0.163998 Aug 30 16:23:46.480096 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 336/667] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:46 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:46.502271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:46.508526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.509011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.509442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.533733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Going to try to start instance {{(pid=120589) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:23:46.581999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ac0351cb-07be-4181-a18a-18eddf3b6204 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.084208 Aug 30 16:23:46.582545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 332/668] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:46 2022] POST /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:46.591008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:46.591657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:46.598575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.599003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.599477 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.600182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.600685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.601064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.611977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:46.612666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:46.618869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.619402 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.619841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.620560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.621006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.621667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.764644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.774408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8aaea775-922f-4f4f-a13d-21f482235097 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1736 microversion: 2.1 time: 0.166267 Aug 30 16:23:46.775146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 333/669] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:46 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:46.786873 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.801304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57cc93a3-bcc7-4076-81ae-27ea73469fbd tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1665 microversion: 2.1 time: 0.214120 Aug 30 16:23:46.801894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 337/670] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:46 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1665 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:47.798062 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:47.798707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:47.805949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.806500 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.806890 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.807631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.808094 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.808508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.822920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:47.824057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:47.831556 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.832052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.832528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.833236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.833703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.834136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.952103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.961738 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a9ef0d7c-ced2-4485-a853-5587bb496dca tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1716 microversion: 2.1 time: 0.167624 Aug 30 16:23:47.962321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 334/671] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:47 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:47.977691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.986127 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fac43a5e-7b54-4593-a9b0-d7ae899f4777 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1665 microversion: 2.1 time: 0.168084 Aug 30 16:23:47.986710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 338/672] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:47 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:48.081959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.082582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.089685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.090253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.090792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.091765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.092289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.092717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.178786 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] HTTP exception thrown: Cannot 'detach_volume' instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 while it is in vm_state rescued Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Request method failure captured: Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments/b5c65d4e-2c74-4da0-b0c0-31b70fa5b854 HTTP/1.1 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgT2xKprBMSu4MTqd9iOyiwhwW0Gm7-LBOAW5vKR3yfLujjpJH-57IXRTpkINxVTEp7zVacc40uGiS6k3Mqd18Wg9VmpDUprnTYADlu4Z2LZlENE9UL1_Tcoru1jwOmOhFrvlDxwPd0W0iNirFw1eLHjC80X6tKouYTnAr4C8hHO5Q Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:23:48.180437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dff1326e1026492080d292aa3a157366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dff1326e1026492080d292aa3a157366"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}] Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 03eed7086183469f8cc1e765422bea87 Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:23:48.182568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Cannot 'detach_volume' instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 while it is in vm_state rescued Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'server_id': '5e00a1dc-6a4c-4d96-88eb-413a7bdf9058', 'id': 'b5c65d4e-2c74-4da0-b0c0-31b70fa5b854'} Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:48.183595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 while it is in vm_state rescued Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 while it is in vm_state rescued Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:23:48.185654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Returning 409 to user: Cannot 'detach_volume' instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 while it is in vm_state rescued {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:48.187120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b9caf608-96d9-4a0d-8050-781861cb4249 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments/b5c65d4e-2c74-4da0-b0c0-31b70fa5b854" status: 409 len: 152 microversion: 2.1 time: 0.104403 Aug 30 16:23:48.187120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 335/673] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:23:48 2022] DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments/b5c65d4e-2c74-4da0-b0c0-31b70fa5b854 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:23:48.191401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.191958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.197951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.198439 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.198878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.199648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.200057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.200487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.271155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-200117ce-3a01-40fc-9dd1-212b5563849d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/action" status: 202 len: 0 microversion: 2.1 time: 0.084059 Aug 30 16:23:48.271922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 339/674] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:48.282696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.283322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.290471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.290967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.291997 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.293279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.293279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.293722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.436445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:48.448247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fdd01d10-b9b3-4626-b8c3-a18df81ec96b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1724 microversion: 2.1 time: 0.169560 Aug 30 16:23:48.449024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 336/675] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:49.009057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.010391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:49.017128 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.017632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.018135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.018790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.019279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.019854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.239969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:49.247936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee54f7f9-f3fe-436b-a584-5018b0b99ba5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1669 microversion: 2.1 time: 0.243674 Aug 30 16:23:49.248592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 340/676] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:49 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:49.471542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.472149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:49.478549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.479028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.479483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.480175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.480625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.481047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.622823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:49.634210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8109c69d-d16b-4c41-bf78-d0e83d0f59d6 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1724 microversion: 2.1 time: 0.166982 Aug 30 16:23:49.634806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 337/677] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:49 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:50.655535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:50.656679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:50.663067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:50.663587 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:50.664022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.664711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:50.665165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:50.665617 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.795425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.804237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ae0b33a-609c-4718-8560-682ba89f7b97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1724 microversion: 2.1 time: 0.152575 Aug 30 16:23:50.804852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 341/678] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:50 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:51.824523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:51.825151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:51.832225 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.832715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.833157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.833854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.834315 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.834743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.963267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:51.972157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ef9712d0-4804-4725-a964-6b5051b38523 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1724 microversion: 2.1 time: 0.151491 Aug 30 16:23:51.972727 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 338/679] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:51 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:52.993431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:52.994047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:53.001350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.002009 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.002483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.003208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.003953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.004386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.141596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:53.149798 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9cfdbc3-82a9-4bf2-902a-9ee64ad833fd tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1730 microversion: 2.1 time: 0.160251 Aug 30 16:23:53.150365 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 342/680] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:52 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:53.169867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:53.170435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:53.176960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.177444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.177880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.178579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.179037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.179496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.257242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4c6f8fcc-16e4-467b-aedf-379610c1c5eb tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091140 Aug 30 16:23:53.257845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 339/681] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:23:53 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:54.490724 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:54.501078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:54.501563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:54.501988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:54.514178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] Creating event network-changed:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:23:54.520102 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-df45860a-d77b-4222-be6f-19ffe5943353 req-5b35ee3d-a800-49eb-a8b8-23e57fb6859e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161864 Aug 30 16:23:54.521259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 343/682] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:56.534957 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:56.544487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.544966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.545392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.549171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:56.556915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] Creating event network-changed:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:23:56.562033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-0d54de08-79e3-4da0-bd50-c91d8c339c13 req-40f6645a-5a50-42e6-9fe2-a3264902a54a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031760 Aug 30 16:23:56.562691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 340/683] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:59.350058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:59.350746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:59.352731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=48 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:59.357837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.358313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.358779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.359507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.360010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.360453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.392605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25ad4f71-8d32-4d91-852f-01c3a6943c4e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments/a79b4666-4e9d-4344-b935-63286d781fa7" status: 200 len: 194 microversion: 2.20 time: 0.050954 Aug 30 16:23:59.393204 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 344/684] 10.222.0.57 () {60 vars in 1454 bytes} [Tue Aug 30 16:23:59 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments/a79b4666-4e9d-4344-b935-63286d781fa7 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:23:59.462338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:59.462925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:59.465375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=52 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:59.472799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.473409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.473805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.474588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.475081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.475497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.560181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lazy-loading 'services' on Instance uuid bef6f406-1466-4883-bb22-2f778347bfac {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:59.636869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d1375862-36e2-4b65-b497-e1823a3012f6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments/a79b4666-4e9d-4344-b935-63286d781fa7" status: 202 len: 0 microversion: 2.20 time: 0.179047 Aug 30 16:23:59.637565 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 341/685] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 30 16:23:59 2022] DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments/a79b4666-4e9d-4344-b935-63286d781fa7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:23:59.646942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:59.649371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:59.655667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.656389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.657538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.658321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.658991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.659617 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.703048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e7f5222-8197-4640-82cd-cb3fc1666d70 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060070 Aug 30 16:23:59.704555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 345/686] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 30 16:23:59 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:24:00.717124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:00.720068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:00.726560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.727048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.727514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.728214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.728675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.729105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.758773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-308f809a-d947-409b-a96e-66f34c38afd6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045984 Aug 30 16:24:00.759357 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 342/687] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 30 16:24:00 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:00.820191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:00.820691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:00.827059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.827580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.828019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.829206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.829659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.830082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.857523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:24:00.933505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da6e9be3-a665-4a2b-a95d-e75f6c31c9b8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 204 len: 0 microversion: 2.20 time: 0.116963 Aug 30 16:24:00.934096 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 346/688] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 30 16:24:00 2022] DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:24:00.942591 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:00.943202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:00.949287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.949769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.950205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.950895 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.951374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.951803 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:01.081532 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:01.089610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:01.091066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:01.092320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-84f1935e-36fa-43f3-8ab1-cbf83ed49667 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.153711 Aug 30 16:24:01.092891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 343/689] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:00 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:02.116970 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:02.117674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:02.124199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.124683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.125149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.125931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.126391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.126824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.260135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:02.268868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:02.270349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:02.271573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25b34f1d-9f3a-4bdc-bae4-b511c1c84bea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.159110 Aug 30 16:24:02.272161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 347/690] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:02 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:24:03.296877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:03.297480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:03.304602 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.305078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.305506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:03.306190 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.306637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.307055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:03.443320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:03.451398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:03.452921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:03.454078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-604e74c6-f0e6-4b44-bf7c-2c9873063534 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1722 microversion: 2.20 time: 0.161175 Aug 30 16:24:03.454640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 344/691] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:03 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:03.940914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef6f406-1466-4883-bb22-2f778347bfac", "name": "network-vif-deleted", "tag": "b7d06551-8904-4327-be8a-2499929b2f74"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:03.950608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.951538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.952213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:03.965353 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] Creating event network-vif-deleted:b7d06551-8904-4327-be8a-2499929b2f74 for instance bef6f406-1466-4883-bb22-2f778347bfac on hv-cinder-85220 Aug 30 16:24:03.971953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-70fd4465-7374-4488-ba90-18eccd1e8cfd req-1e0e7cca-4557-43fe-ac13-682250579cc2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035839 Aug 30 16:24:03.972833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 348/692] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:04.479548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:04.480090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:04.488028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.488521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.488964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.489675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.490131 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.490553 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.525907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.526396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.526840 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.527401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lazy-loading 'fault' on Instance uuid bef6f406-1466-4883-bb22-2f778347bfac {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:04.569801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:04.578789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:04.580858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:04.582029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-895dd9ef-53f2-405d-9d5c-80845d8f664e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 200 len: 1370 microversion: 2.20 time: 0.106742 Aug 30 16:24:04.582854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 345/693] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:04 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:05.606260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:05.606969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:05.614932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.615472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.615904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.616601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.617060 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.617634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.632275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac HTTP/1.1 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:24:05.633923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:24:05.635719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'bef6f406-1466-4883-bb22-2f778347bfac'} Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:05.636480 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:24:05.637693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.638817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:05.638817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-906fcee2-4a4c-4cf4-8cc8-f98de328f8a7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 404 len: 111 microversion: 2.20 time: 0.033617 Aug 30 16:24:05.638817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 349/694] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:05 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:24:05.644242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ecd36684-daef-4d84-8a24-ad0517b2d71f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '.version_select at 0x7f1266a50820>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:05.672362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ecd36684-daef-4d84-8a24-ad0517b2d71f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217951726" status: 204 len: 0 microversion: 2.20 time: 0.031837 Aug 30 16:24:05.673731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 346/695] 10.222.0.57 () {60 vars in 1259 bytes} [Tue Aug 30 16:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217951726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:24:06.333223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75aa5bd7-a413-4946-8fec-357e75490989 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: .version_select at 0x7f1266c41310>, body: {"keypair": {"name": "tempest-keypair-342521177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSp/bclyeTMM5H7HHSkV6Z/ISyPyeQUNy6jh3p2nsCi6wLLtsrcyYtP9d2JzgZpzTN3e+fB0/33Akq2HLZAUBQ1WFi5EGVJ4hgoVIBk4nZQlXFpSAc8Yq0sATp3hU/htg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:06.348901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-75aa5bd7-a413-4946-8fec-357e75490989 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for project d07b587d6ac148b0a7751c851260b3bc. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:06.352597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-75aa5bd7-a413-4946-8fec-357e75490989 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for user c3dc3a92c6424cdbb3a2d3c1baaa95e3 and project d07b587d6ac148b0a7751c851260b3bc. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:06.379596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75aa5bd7-a413-4946-8fec-357e75490989 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050765 Aug 30 16:24:06.380211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 350/696] 10.222.0.57 () {62 vars in 1200 bytes} [Tue Aug 30 16:24:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:24:07.686196 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-240096608", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "263eb0c3-89d1-4ff2-8ff6-6433b63ba805"}], "security_groups": [{"name": "tempest-securitygroup--1050127024"}], "key_name": "tempest-keypair-342521177", "user_data": "}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:07.789863 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] validate_networks() for [('263eb0c3-89d1-4ff2-8ff6-6433b63ba805', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:08.196738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:08.197259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:08.204653 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.205194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.205624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.206318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.206797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.207266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.229858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lazy-loading 'flavor' on Instance uuid 4fe265cd-29be-4514-a1d0-65f15799ff0d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:08.268546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:08.268979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:08.269483 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:08.269897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:08.270312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:08.271826 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:08.280205 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.280732 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.281221 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.281963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.282443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.282931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.301387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for project d07b587d6ac148b0a7751c851260b3bc. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:08.305518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Getting quotas for user c3dc3a92c6424cdbb3a2d3c1baaa95e3 and project d07b587d6ac148b0a7751c851260b3bc. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:08.307780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9df83a0-c756-45d9-ae26-3b17f81fceb6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "POST /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d/action" status: 202 len: 0 microversion: 2.1 time: 0.229426 Aug 30 16:24:08.308568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 351/697] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:08 2022] POST /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:24:08.317702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:08.317908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:08.318461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:08.320166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:08.325005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.325551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.326067 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.326805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:08.327280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:08.327711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:08.367399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-49a943ea-8fb7-42e2-a07b-e1087af0f8c1 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.685951 Aug 30 16:24:08.368336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 347/698] 10.222.0.57 () {62 vars in 1188 bytes} [Tue Aug 30 16:24:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:24:08.379563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:08.380379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:08.445582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:08.454971 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:08.456497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:08.457785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-651c6036-63a1-436a-a2a6-87d57a20e3f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1280 microversion: 2.20 time: 0.082534 Aug 30 16:24:08.458555 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 348/699] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:08 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:24:08.499175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:08.508815 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09dbcb70-08b1-48db-a1b3-1a8f8d0bf19a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.195754 Aug 30 16:24:08.509396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 352/700] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:08 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:09.482745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:09.483375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:09.490185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.490664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.491102 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.491814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.492261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.492682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.529876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:09.530396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:09.537178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.537665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.538098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.538794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.539270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.539696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.555153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:09.563819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:09.565286 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:09.566399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-81491c71-7420-4a1f-98d1-59c964ffda8e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1332 microversion: 2.20 time: 0.087686 Aug 30 16:24:09.566960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 349/701] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:09 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:09.685803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:09.694217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6aca7d3-2b6f-4a68-8cdb-e6f0cfa2be5a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.168090 Aug 30 16:24:09.694798 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 353/702] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:09 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:10.589519 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:10.590127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:10.598195 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.598695 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.599139 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.599887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.600526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.601124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.717971 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:10.718940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:10.726351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.727316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.727978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.729263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.729994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.730693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.760190 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.771579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.773446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.775392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a29bab6d-825f-4d8a-a8af-e196c4954ff8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.189573 Aug 30 16:24:10.776278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 350/703] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:10 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:10.961794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.970291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-672ad4d3-8ffd-46f5-9ffa-82a84104d01a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.256565 Aug 30 16:24:10.970978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 354/704] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:10 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:11.270320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:11.280278 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.280783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.281370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.295332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] Creating event network-changed:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:24:11.300193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-ad0a571e-92da-4d91-a5c7-ed467fda8f55 req-9e6a72a5-3c25-4586-a92f-388cd3742e48 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034496 Aug 30 16:24:11.300806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 351/705] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:11.799335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:11.799952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:11.807310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.807813 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.808257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.808980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.809443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.809874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.941535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:11.949641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:11.951103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:11.952240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66170649-9f3b-4e4e-b858-c22c39f74b63 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.157636 Aug 30 16:24:11.952800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 355/706] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:11 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:11.993314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:11.994019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.000363 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.000877 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.001317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.002009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.002466 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.002889 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.138824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:12.147183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a31a18bd-3df8-4b9b-b9c8-1abbb9f7023d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.158453 Aug 30 16:24:12.147725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 352/707] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:11 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:12.974611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:12.975241 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.981381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.981867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.982312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.983015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.983500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.983940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.111528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.120013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.121588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.122710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06bdc9ef-b696-4366-b380-2c22c7933ab0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.152267 Aug 30 16:24:13.123307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 356/708] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:12 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:13.168798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:13.169412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:13.176529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.177093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.177491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.178160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.178617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.179043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.312638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.321392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f45fef31-5393-4aff-89c9-95dd18fc9578 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.156511 Aug 30 16:24:13.321966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 353/709] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:13 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:14.146236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:14.146848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:14.153206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.153700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.154146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.155034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.155347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.155779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.292643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.300735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.302209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.303345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3525bf8e-f47b-4b2a-b5f1-4f53935b6fe0 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.161149 Aug 30 16:24:14.303942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 357/710] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:14 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:14.343663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:14.344261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:14.351492 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.351981 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.352417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.353109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.353583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.353990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.493751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.502491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0d7058c5-4238-48a7-809b-67205d5b5dca tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.162590 Aug 30 16:24:14.503393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 354/711] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:14 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:15.325818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:15.326523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:15.333810 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.334307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.334753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.335484 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.335950 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.336378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.524905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:15.525464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:15.532237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.532739 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.533174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.533887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.534358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.534771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.678876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.686702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d6e28a8b-7348-4123-b76a-f732968fb9b4 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.165939 Aug 30 16:24:15.687325 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 355/712] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:15 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:15.717259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.725840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.727316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.728416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cbfcd2a-c492-44c3-9110-564f021bbbac tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.406583 Aug 30 16:24:15.728969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 358/713] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:15 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:16.709180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:16.709789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:16.716129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.716607 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.717043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.717739 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.718193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.718617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.750388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:16.763263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:16.765678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:16.770479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.771071 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.771971 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.772294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.772763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.773194 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.861165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.869451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0b2f44ff-27df-47a6-90d3-ffe5774025fa tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.164129 Aug 30 16:24:16.870037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 356/714] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:16 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:16.916640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.926515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.927976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.929076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f0f66f5-c899-4d1f-8522-9ae1061a2e14 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.182881 Aug 30 16:24:16.930179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 359/715] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:16 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:16.940291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "name": "network-vif-plugged", "status": "completed", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:16.949640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.950119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.950554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.961234 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] Creating event network-vif-plugged:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:24:16.966084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-abb75790-3157-4f1a-ac32-9bbd8d5af49b req-47647d54-ff68-431f-9e1b-eee35562665b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094950 Aug 30 16:24:16.966666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 357/716] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:17.215699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-52949364"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:17.216237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:17.222217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.222703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.223146 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.223865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.224324 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.224754 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.348332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Removing security group 85c0fe07-87cb-4b9a-8c22-30f9e1ca9e3b from port 4d43c92c-0daf-4310-874f-a1d618cff05a Aug 30 16:24:17.682233 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6674fb33-27a3-4f19-9fee-1e75c996d55f tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action" status: 202 len: 0 microversion: 2.1 time: 0.470304 Aug 30 16:24:17.686515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 360/717] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:17 2022] POST /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:17.690953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:17.700584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.701063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.701494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.713587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] Creating event network-changed:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:24:17.720027 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-9456ffc4-5c38-4ea0-9540-052119dc0efe req-fa0f6c47-cd7c-40bf-80e2-118d12aa1b14 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Aug 30 16:24:17.720955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 358/718] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:24:17.891435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:17.892707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:17.903337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.903706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.904234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.904844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.905371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.905769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.952090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:17.952698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:17.960735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.961374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.961817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.962525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.963614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.964113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:18.101304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.110096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.112523 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.113830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9332ec76-8de6-4002-9996-a3b1fc4f7856 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.166380 Aug 30 16:24:18.114494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 359/719] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:17 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:18.163646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.171209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50924996-b733-4a56-8bc9-990c662ad259 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.284228 Aug 30 16:24:18.171806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 361/720] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:17 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:18.978291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:18.979002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:18.981284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:18.982081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=8 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:18.989172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.989713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.990146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:18.991779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.993936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.994384 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.081427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lazy-loading 'services' on Instance uuid 3ccb3c81-d3dd-4848-9016-6b5ca73a370c {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:19.085181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:19.138425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.139032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.151416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.152123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.152826 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.153776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.154631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.155311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.179034 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-17600766-8e6f-466f-8f72-4d5e04089394 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments/65caea7c-9857-4c54-8495-aa0afe0d6609" status: 202 len: 0 microversion: 2.1 time: 0.204503 Aug 30 16:24:19.180657 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 360/721] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:24:18 2022] DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments/65caea7c-9857-4c54-8495-aa0afe0d6609 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:19.193730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.197017 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.203754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.205014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.205629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.206341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.206799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.207243 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.245652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-778a6dfb-cb6d-4f23-be17-01784de107ee tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059649 Aug 30 16:24:19.246818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 361/722] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:19.254716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.255671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.264712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.265524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.266259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.267679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.268435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.269023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.369474 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.389252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.394401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.397681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c9e6d2b-3fe8-4b4e-a29e-ce6199124593 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1406 microversion: 2.20 time: 0.263986 Aug 30 16:24:19.399271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 362/723] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:24:19.461881 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.469870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-52ab6f5f-29f2-4ce7-9845-1bf5d2b15eae tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.221352 Aug 30 16:24:19.470475 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 362/724] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:19.739719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:19.750113 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.750593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.751247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.764170 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] Creating event network-changed:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:24:19.770284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fb7012df-39f9-4d9c-ae72-be01746a67e2 req-56b13b0b-2586-470d-ab48-415158054dc3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034075 Aug 30 16:24:19.771164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 363/725] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:24:20.258407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.260615 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.267408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.267893 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.268324 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.269015 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.269465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.269899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.300216 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5e9fd6e0-d684-475d-9c43-ea1f54940120 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045705 Aug 30 16:24:20.300787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 363/726] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:20.313380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.314011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.320330 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.320821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.321266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.321970 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.322431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.322862 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.399957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] HTTP exception thrown: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c is not attached to volume 65caea7c-9857-4c54-8495-aa0afe0d6609 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Request method failure captured: Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments/65caea7c-9857-4c54-8495-aa0afe0d6609 HTTP/1.1 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjiKyhDv0kbc6rFbN9pGMX4v2GPJd88wh2E-eJ9Gmo2a2FwekJUHH72KAbpr-YGi1MOl1rP-zcHe4BLpex35Bmz5jyzzbI4msqW91u29es-JxEueQKCah6oQ_weOUDZWmKoFuVqKvrdEIssON8-JCQV5X7PQowhUZ_7DOcvJmf0HtrI Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 568821f418bb465193aac9ec311b59b2 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:24:20.402342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_568821f418bb465193aac9ec311b59b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/568821f418bb465193aac9ec311b59b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/568821f418bb465193aac9ec311b59b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/568821f418bb465193aac9ec311b59b2"}]}] Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 568821f418bb465193aac9ec311b59b2 Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-1907668772-project Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c7e2f2b39c84479aa194cfed89d8376b Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-1907668772-project Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:24:20.404794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c is not attached to volume 65caea7c-9857-4c54-8495-aa0afe0d6609 Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'server_id': '3ccb3c81-d3dd-4848-9016-6b5ca73a370c', 'id': '65caea7c-9857-4c54-8495-aa0afe0d6609'} Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65caea7c-9857-4c54-8495-aa0afe0d6609. Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:20.405664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c is not attached to volume 65caea7c-9857-4c54-8495-aa0afe0d6609 Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c is not attached to volume 65caea7c-9857-4c54-8495-aa0afe0d6609 Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:20.408131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Returning 404 to user: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c is not attached to volume 65caea7c-9857-4c54-8495-aa0afe0d6609 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:20.409329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21a41fe0-6fe8-42d5-a6be-4473b7efdda2 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments/65caea7c-9857-4c54-8495-aa0afe0d6609" status: 404 len: 154 microversion: 2.1 time: 0.095440 Aug 30 16:24:20.409329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 364/727] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:24:20 2022] DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c/os-volume_attachments/65caea7c-9857-4c54-8495-aa0afe0d6609 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:20.431551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.432640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.447083 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.447852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.448302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.449019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.449479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.449908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.492812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.493553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.502902 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.504400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.505124 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.506059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.506773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.507288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.660341 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.665399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.668675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28ff419c-58a7-4251-93b6-b3a46f4e15b6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.180634 Aug 30 16:24:20.669198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 365/728] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:20.674122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.675585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.676748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4b3aea9d-8c41-4f2c-80ee-dcd78edb5aef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1599 microversion: 2.20 time: 0.258860 Aug 30 16:24:20.677284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 364/729] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:20.699841 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.700302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.707528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.708029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.708523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.709286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.709753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.710186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.799295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9682a666-82e7-4d03-bbe9-dfba917cc580 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103765 Aug 30 16:24:20.800078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 366/730] 10.222.0.57 () {60 vars in 1316 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:24:21.585306 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:21.585860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:21.592461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.593005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.593429 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.594655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.595128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.595594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.625652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:24:21.691835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:21.695940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:21.707706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.708258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.710605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.713075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.713282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2585ece7-500d-4974-a840-278f8f1d036c tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 204 len: 0 microversion: 2.1 time: 0.131583 Aug 30 16:24:21.713966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.715442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.715564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 365/731] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:24:21 2022] DELETE /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:24:21.727435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:21.728145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:21.734348 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.735542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.735992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.736702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.737163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.737590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.881641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:21.889760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d40516ba-c58f-477e-b379-8f927eb32ee8 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.203785 Aug 30 16:24:21.890377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 367/732] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:21 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:22.002206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:22.010296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-451c2435-7fe2-4e08-a877-0974ee8c1cbb tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1552 microversion: 2.1 time: 0.287153 Aug 30 16:24:22.010879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 366/733] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:21 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1552 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:22.331806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:22.341442 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.341926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.342400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.353593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] Creating event network-changed:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:24:22.358459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a091c570-28c1-4fb2-a397-a1d7250037d0 req-168cfc06-f3a0-46f4-86a3-4f8a4eb7a76a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Aug 30 16:24:22.359066 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 368/734] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:22.910918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:22.911573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:22.917793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.918282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.918729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.919461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.919919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.920349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.033572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:23.034938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:23.041886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.042425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.042878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.043689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.044158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.044585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.056801 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:23.066067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0298f48f-cfb4-479c-b2e0-7d2986656c17 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.159436 Aug 30 16:24:23.067179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:23.075787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 367/735] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:22 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:23.193794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:23.202405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-871af8a0-1fb0-4115-82b2-6c9c5458fe31 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1552 microversion: 2.1 time: 0.174284 Aug 30 16:24:23.202990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 369/736] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:23 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:24.087115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:24.087772 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:24.096134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.096664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.097285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.097911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.098476 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.098913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.226176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:24.227056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:24.238077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.239185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.240165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.241680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.242877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.244042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.350061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.357635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.359191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f39b567c-89e1-481c-b245-b0b753b0d81e tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1510 microversion: 2.1 time: 0.139115 Aug 30 16:24:24.368177 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8bddfb91-dbf0-4934-bf70-95adf8897f89 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.285029 Aug 30 16:24:24.379545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 368/737] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:24 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:24.379545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccb3c81-d3dd-4848-9016-6b5ca73a370c", "name": "network-vif-deleted", "tag": "4d43c92c-0daf-4310-874f-a1d618cff05a"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:24.379931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 370/738] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:24 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:24.388151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.389517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.390304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.570365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] Creating event network-vif-deleted:4d43c92c-0daf-4310-874f-a1d618cff05a for instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c on hv-cinder-85220 Aug 30 16:24:24.575603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-a419a9b9-c69a-4dbd-9f64-ca415e9273c8 req-a2411d99-f2d5-4c76-8b1e-e0ba68097b39 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205621 Aug 30 16:24:24.576561 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 369/739] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:25.382211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.382823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.389467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.389959 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.390404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.391704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.392167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.392597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.394505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.395189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.401650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.402132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.402696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.403450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.403902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.404491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.424714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.428403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.429198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.429949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lazy-loading 'fault' on Instance uuid 3ccb3c81-d3dd-4848-9016-6b5ca73a370c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:25.480642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e2f2b39c84479aa194cfed89d8376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568821f418bb465193aac9ec311b59b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:25.488368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-209d865a-c60a-4249-ac76-7a055a9209a8 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 200 len: 1347 microversion: 2.1 time: 0.110268 Aug 30 16:24:25.488942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 371/740] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:25.548867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:25.556942 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6eef641b-2e0b-4487-8814-586af1d2a6c0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.167188 Aug 30 16:24:25.557527 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 370/741] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:26.511043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.511888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] [instance: 3ccb3c81-d3dd-4848-9016-6b5ca73a370c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.518370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.518996 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.519512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.520226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.520692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.521126 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.535446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] HTTP exception thrown: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Request method failure captured: Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c HTTP/1.1 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjiKyhDv0kbc6rFbN9pGMX4v2GPJd88wh2E-eJ9Gmo2a2FwekJUHH72KAbpr-YGi1MOl1rP-zcHe4BLpex35Bmz5jyzzbI4msqW91u29es-JxEueQKCah6oQ_weOUDZWmKoFuVqKvrdEIssON8-JCQV5X7PQowhUZ_7DOcvJmf0HtrI Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 568821f418bb465193aac9ec311b59b2 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:24:26.537105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_568821f418bb465193aac9ec311b59b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/568821f418bb465193aac9ec311b59b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/568821f418bb465193aac9ec311b59b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/568821f418bb465193aac9ec311b59b2"}]}] Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 568821f418bb465193aac9ec311b59b2 Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1907668772 Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-1907668772-project Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c7e2f2b39c84479aa194cfed89d8376b Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-1907668772-project Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. Aug 30 16:24:26.538706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '3ccb3c81-d3dd-4848-9016-6b5ca73a370c'} Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:26.539672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. Aug 30 16:24:26.541207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:24:26.542514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Returning 404 to user: Instance 3ccb3c81-d3dd-4848-9016-6b5ca73a370c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:26.542514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1364cad9-cdc3-4732-824e-9d0124ad8091 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c" status: 404 len: 111 microversion: 2.1 time: 0.031871 Aug 30 16:24:26.542514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 372/742] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:26 2022] GET /compute/v2.1/servers/3ccb3c81-d3dd-4848-9016-6b5ca73a370c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:26.548045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e5af1ffe-fc17-45ae-ad9c-13358d322553 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] Calling method '.version_select at 0x7f1266a50dc0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.567766 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e5af1ffe-fc17-45ae-ad9c-13358d322553 tempest-TestMinimumBasicScenario-1907668772 tempest-TestMinimumBasicScenario-1907668772-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-620780505" status: 202 len: 0 microversion: 2.1 time: 0.024028 Aug 30 16:24:26.568328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 371/743] 10.222.0.57 () {58 vars in 1269 bytes} [Tue Aug 30 16:24:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-620780505 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:26.582344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.583105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.591027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.591685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.592218 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.593039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.593628 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.594231 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.782885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:26.794379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3465970-ed65-41f2-ba97-d2ea52648ee6 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.218162 Aug 30 16:24:26.795132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 373/744] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:26 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:26.827734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "name": "network-vif-unplugged", "status": "completed", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:26.841194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.842005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.842439 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.856069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] Creating event network-vif-unplugged:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:24:26.863388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-9f8fca01-690a-4ac5-bf4a-0fd05b856ba9 req-30fd838d-443a-40c8-a151-241cf2f81148 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038974 Aug 30 16:24:26.864222 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 372/745] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:24:27.817162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:27.817779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:27.823984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.824470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.824915 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:27.825614 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.826075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.826506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.054158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:28.061802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a668612c-8d16-4981-a293-8fc5f9d48fe2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1507 microversion: 2.1 time: 0.249159 Aug 30 16:24:28.062381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 374/746] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:27 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:28.084048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:28.084732 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:28.091498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.091989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.092429 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.093253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.093715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.094145 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.140362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120589) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:24:28.153156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:28.217658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6daa1679-82e3-41d8-ad24-3ecdcf0bc597 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "POST /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d/action" status: 202 len: 0 microversion: 2.1 time: 0.137677 Aug 30 16:24:28.218561 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 373/747] 10.222.0.57 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:28 2022] POST /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:28.227498 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:28.228215 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:28.235473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.236053 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.236580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.237443 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.238023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.238561 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.551669 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:28.559812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed9e8ebf-9a8b-40dc-a629-5d5454d4ffde tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1515 microversion: 2.1 time: 0.336343 Aug 30 16:24:28.561117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 375/748] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:28 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:29.584459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:29.585790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:29.592135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.592766 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.593797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.594916 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.595982 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.596751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.801929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.812977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2a73b449-305b-44e9-90bf-9bdca9f7d5ed tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1517 microversion: 2.1 time: 0.233132 Aug 30 16:24:29.817865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 374/749] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:29 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:30.834823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:30.836323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:30.850912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:30.852860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.853514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.855949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.860850 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.861781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.864923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.085572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:31.094834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa3f2514-8fac-4440-978b-867bb6903495 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.263267 Aug 30 16:24:31.096226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 376/750] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:30 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:32.117149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:32.117821 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:32.124448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.124931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.125396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.126092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.126540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.126963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.379329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:32.387612 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-42eb022d-e655-454e-9e47-4bb611328b57 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.274368 Aug 30 16:24:32.388318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 375/751] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:32 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:33.409207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:33.409955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:33.416861 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.417466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.418001 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.418799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.419450 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.419878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.558545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:33.566573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-749686a7-7b6d-481f-be20-6bcb2bd5ee7d tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.161190 Aug 30 16:24:33.567202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 377/752] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:33 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:34.589336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:34.589970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:34.599113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.599655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.600448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.601458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.601687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.602769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.778905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:34.783005 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:34.788730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33b3c2ed-e513-4047-99cb-04efb19bac94 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.203291 Aug 30 16:24:34.789342 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 376/753] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:34 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:35.810043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:35.810660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:35.817875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.818378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.818933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.819623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.820090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.820525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.959039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:35.966736 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0cbbaf20-02ea-4d3f-9828-f401c6e49b00 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.160623 Aug 30 16:24:35.967335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 378/754] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:35 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:36.988992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:36.989586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:36.996827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.997313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.997754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.998444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.998900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.999356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.134354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:37.142018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bc39ded7-5dbe-4488-b7ce-cd301c70fa0e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.157756 Aug 30 16:24:37.142578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 377/755] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:36 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:38.165658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:38.166301 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:38.172700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:38.173793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:38.174228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:38.174918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:38.175411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:38.175835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:38.311161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:38.318918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7fa5b925-2e6e-45fe-9339-7fea90e8c431 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.157102 Aug 30 16:24:38.319524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 379/756] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:38 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:39.341687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:39.342316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:39.349166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.349662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.350104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.350815 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.351300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.351735 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.482700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:39.491438 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-082c72e1-32bc-4d20-9d6e-2acaabe4fd26 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.155066 Aug 30 16:24:39.505624 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 378/757] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:39 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.513041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:40.513638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:40.520775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.521260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.521711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.522408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.522867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.523331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.660583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:40.668386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0186a29-0019-4a70-8155-547bac62bbea tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.159243 Aug 30 16:24:40.668953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 380/758] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:40 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.905473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "name": "network-vif-plugged", "status": "completed", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:40.915998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.916509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.916961 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.928566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] Creating event network-vif-plugged:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:24:40.933639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-253830fd-8eee-43db-875b-977ecfbec6d8 req-f294ae33-00da-45c3-b49f-e4395d0b7000 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032072 Aug 30 16:24:40.934377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 379/759] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:41.690260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:41.690873 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:41.697436 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:41.697923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:41.698368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:41.699065 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:41.699555 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:41.699984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:41.830306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:41.838084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebaf3ffe-8ded-4b89-9907-bf4e81916e60 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1573 microversion: 2.1 time: 0.152202 Aug 30 16:24:41.838656 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 381/760] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:41 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:42.860092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:42.861310 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:42.867554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:42.868041 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:42.868478 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:42.869172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:42.869632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:42.870063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:43.000470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:43.009164 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4ef6ecd4-4f34-4180-933b-7794787ab1fc tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1560 microversion: 2.1 time: 0.153819 Aug 30 16:24:43.009733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 380/761] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:42 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:52.702567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:52.704842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:52.707022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=11 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:52.707690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=72 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:52.713157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.713639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.714077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.714769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.715244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.715672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.744557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3d1b8a1-ecea-479e-a8ba-da22ebb3935c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045864 Aug 30 16:24:52.745117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 382/762] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:24:52 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:52.807428 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:52.808127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:52.813984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.815078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.815548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.816236 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.816692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.817109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.841156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:24:52.919860 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33d10e37-c9e7-4e85-ab5e-b473a1966216 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 204 len: 0 microversion: 2.1 time: 0.115679 Aug 30 16:24:52.920018 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 381/763] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:24:52 2022] DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:24:52.929000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:52.929645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:52.935618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.936112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.936551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.937242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.937704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.938133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.087827 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:53.097797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c90dc23c-706a-436d-98e4-8ccd3ac5e843 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1675 microversion: 2.1 time: 0.172705 Aug 30 16:24:53.098387 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 383/764] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:52 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:54.120238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:54.120952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:54.127441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.128577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.129277 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.129975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.130435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.130865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.262183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:54.270023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-df58e794-1481-4351-93a6-775d21f53c3a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1675 microversion: 2.1 time: 0.154030 Aug 30 16:24:54.270590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 382/765] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:54 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:55.293276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:55.294021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:55.301596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.302179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.302672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70cd69f5-b796-45fb-a89f-d7d39864d2ae", "name": "network-vif-deleted", "tag": "1a19abfd-980a-447d-a628-c8d4ce1e2dc0"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:55.303130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.303871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.304406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.305007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.320296 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.320936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.323174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.339399 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] Creating event network-vif-deleted:1a19abfd-980a-447d-a628-c8d4ce1e2dc0 for instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae on hv-cinder-85220 Aug 30 16:24:55.345022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-2104e751-de0a-433b-86ee-2410755a4809 req-bda2f05c-29b7-481e-a6f7-fd4c74abec16 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045796 Aug 30 16:24:55.346004 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 383/766] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:55.391165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:55.400393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3853f49f-f9a6-406c-8612-406f5a23fc3e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 200 len: 1607 microversion: 2.1 time: 0.112253 Aug 30 16:24:55.411767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 384/767] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:55 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 1607 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:56.423006 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:56.423725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:56.430702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.431194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.431659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:56.432376 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.432823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.433245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:56.448313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae HTTP/1.1 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:24:56.449992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:24:56.451800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '70cd69f5-b796-45fb-a89f-d7d39864d2ae'} Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:56.452664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:24:56.453963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:24:56.455161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:56.455161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-901e221e-b0fd-4217-a4b3-c4d0ef33bed5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 404 len: 111 microversion: 2.1 time: 0.033169 Aug 30 16:24:56.455161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 384/768] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:56 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:56.460898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0a81a5f-6aa4-40f5-8b11-e0c891a2846a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '.version_select at 0x7f1266bba700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:56.481586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0a81a5f-6aa4-40f5-8b11-e0c891a2846a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843169632" status: 202 len: 0 microversion: 2.1 time: 0.024420 Aug 30 16:24:56.482214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 385/769] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 30 16:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843169632 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:57.113352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6a7f2a5d-d9ed-4de5-970a-9f316b137276 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: .version_select at 0x7f1266ca8c10>, body: {"keypair": {"name": "tempest-keypair-650023416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkwoDCKC1ugzIilFpel0P0x/+vaFH4GdOE8BxZMzAGjARXeDwllSl/tRgetnvW38KuwbQd5lH35mDSTyIJldGrvuQcwkAkBRCvkppQ2cc2KihW4p5kMGTF905KCjg2pTQ=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:57.128574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6a7f2a5d-d9ed-4de5-970a-9f316b137276 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:57.132658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6a7f2a5d-d9ed-4de5-970a-9f316b137276 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for user ecf0e8a3fae04b499310fe0d35c08269 and project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:57.154597 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6a7f2a5d-d9ed-4de5-970a-9f316b137276 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045180 Aug 30 16:24:57.155197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 385/770] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:24:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:58.469516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-614580390", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de00c1cc-2bdc-42b7-bcad-30bc1d706f70"}], "security_groups": [{"name": "tempest-securitygroup--1478819803"}], "key_name": "tempest-keypair-650023416", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:58.584150 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] validate_networks() for [('de00c1cc-2bdc-42b7-bcad-30bc1d706f70', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:59.094109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:59.094547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:59.095030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:59.095496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:59.095920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:59.105362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.105806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.106247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.106987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.107492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.107935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.127394 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:59.131670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Getting quotas for user ecf0e8a3fae04b499310fe0d35c08269 and project 1c0d98b877d6458cb0e4c49dc8a57485. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:59.142802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:59.145149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:59.191151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e29a75de-46fb-4457-9455-bfbb7f88b2e5 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726530 Aug 30 16:24:59.192038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 386/771] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:24:59.203090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e8ae2663-7a54-48cb-8379-fb270db81f0d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:59.203747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e8ae2663-7a54-48cb-8379-fb270db81f0d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:59.206519 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:59.264452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e8ae2663-7a54-48cb-8379-fb270db81f0d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:59.271915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e8ae2663-7a54-48cb-8379-fb270db81f0d tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1236 microversion: 2.1 time: 0.073163 Aug 30 16:24:59.272680 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 386/772] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:59 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:00.293332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:00.294156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:00.300933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:00.301530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:00.302059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:00.302846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:00.303413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:00.303919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:00.374800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:00.385178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c95b1c3c-2df7-4c77-839e-08e598b4541a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1296 microversion: 2.1 time: 0.096317 Aug 30 16:25:00.391284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 387/773] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:00 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:01.021146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:01.022052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:01.029518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.030016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.030442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.031464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.032201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.032622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.120769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lazy-loading 'services' on Instance uuid 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:01.202275 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-58e857cd-5a7d-4a10-858c-58c7e1b38a5d tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments/b5c65d4e-2c74-4da0-b0c0-31b70fa5b854" status: 202 len: 0 microversion: 2.1 time: 0.186238 Aug 30 16:25:01.203421 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 387/774] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:25:01 2022] DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments/b5c65d4e-2c74-4da0-b0c0-31b70fa5b854 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:01.212478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:01.214747 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:01.233889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.234426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.235082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.235834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.236454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.236917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.271493 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2034e33b-f700-4146-b365-48fc1be29a97 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062604 Aug 30 16:25:01.272210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 388/775] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:25:01 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:01.409526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:01.410224 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:01.417823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.418361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.418740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.419463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.419916 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.420335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.653129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:01.660751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4fef9ff9-465f-4ebc-9d2f-80009a4af063 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.255404 Aug 30 16:25:01.661370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 388/776] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:01 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:01.771196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e22c005-ce81-45fd-8b26-b89896b4d035", "tag": "da28c5bc-b832-4c65-8b00-6d58528cf74b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:01.780942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.781422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.781848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.796119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] Creating event network-changed:da28c5bc-b832-4c65-8b00-6d58528cf74b for instance 7e22c005-ce81-45fd-8b26-b89896b4d035 on hv-cinder-85220 Aug 30 16:25:01.804425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b4c82183-7dc5-43e0-b2fb-501820c5836a req-d3fcaae6-65b7-46b0-88c3-5df45b444678 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036632 Aug 30 16:25:01.805379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 389/777] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:02.284502 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:02.286800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.293231 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.293722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.294163 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.294903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.295385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.295815 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.325013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5a374d87-f322-4f76-9709-749133397c2e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045192 Aug 30 16:25:02.325583 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 389/778] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:25:02 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:25:02.407765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:02.408356 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.415323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.415822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.416297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.417003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.417462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.417896 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.443314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:02.526459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b1cf3ce-a2b8-4048-bdb2-4f1fb2e1638e tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 204 len: 0 microversion: 2.1 time: 0.122331 Aug 30 16:25:02.527261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 390/779] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:25:02 2022] DELETE /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:25:02.536095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:02.536810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.542837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.543371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.543828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.544512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.545036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.545464 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.678386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:02.682132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:02.682822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.686294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f5b0c1b2-e80e-49c8-b878-970821182111 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.155090 Aug 30 16:25:02.686824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 390/780] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:02 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:02.689595 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.690609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.691104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.691858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.692346 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.692777 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.823699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:02.832019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9ecc36c-f81f-4e64-8418-3c2502cef95b tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.154083 Aug 30 16:25:02.832597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 391/781] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:02 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:03.707751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:03.708366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:03.714894 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.715417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.715859 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.716575 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.717036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.717463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.854423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:03.855048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:03.866663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.867158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.868821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.870145 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.870145 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.870357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.870567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:03.880694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d2e23e47-1361-4252-968a-574f6e709956 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.177204 Aug 30 16:25:03.887616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 391/782] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:03 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:04.015084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:04.024452 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07ec25b8-c385-4d92-84d8-4547b350c616 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.174430 Aug 30 16:25:04.025500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 392/783] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:03 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:04.902219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:04.902749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:04.909776 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:04.910269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:04.910719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:04.911458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:04.911922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:04.912350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.044358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:05.046002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:05.046657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:05.053512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-828a7cbe-bf72-41cc-8e96-00e40a2bf5ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.155236 Aug 30 16:25:05.054088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 392/784] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:04 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:05.060226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.060868 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.061375 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.062163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.062733 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.063334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.196057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:05.203680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ede94986-70b0-4e34-a4c8-44eb608e5937 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.161560 Aug 30 16:25:05.204250 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 393/785] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:05 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:06.075189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:06.075827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:06.082363 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.082851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.083330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.084037 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.084499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.084928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.223540 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:06.225259 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:06.226112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:06.231490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1d3bacd3-cc09-4779-a695-35e7cd6b2a27 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.160171 Aug 30 16:25:06.232066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 393/786] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:06 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:06.232479 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.232962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.233400 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.234091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.234550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.234973 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.365741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:06.373697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a202aff-c57f-4db1-afc0-8dc6ea6a97de tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.152816 Aug 30 16:25:06.374269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 394/787] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:06 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:07.030448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e22c005-ce81-45fd-8b26-b89896b4d035", "name": "network-vif-plugged", "status": "completed", "tag": "da28c5bc-b832-4c65-8b00-6d58528cf74b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:07.042854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.043440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.043878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.046745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:07.058714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] Creating event network-vif-plugged:da28c5bc-b832-4c65-8b00-6d58528cf74b for instance 7e22c005-ce81-45fd-8b26-b89896b4d035 on hv-cinder-85220 Aug 30 16:25:07.063825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-ac476db4-d3c9-4f68-92d0-05a9fdaf06f7 req-1089c331-abca-47f1-abb7-4dc59ce230cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 Aug 30 16:25:07.064590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 394/788] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:07.251814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:07.252344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:07.258932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.259447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.259886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.260570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.261024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.261446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.389949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:07.395962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:07.396665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:07.398546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-055fe748-a402-4588-a811-b7c7034cc3bc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.150529 Aug 30 16:25:07.399052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 395/789] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:07 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:07.403391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.403884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.404325 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.405033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.405490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.405919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.537072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:07.544791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1aff067e-b9fa-4e26-893b-e6dd0c347a02 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.153605 Aug 30 16:25:07.545358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 395/790] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:07 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:08.421201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:08.421809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:08.428814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.429305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.429745 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.430451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.430910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.431370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.562712 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:08.564855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:08.565908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:08.571619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f563568-8889-49ac-a067-0a5670d3e2cc tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1690 microversion: 2.1 time: 0.154224 Aug 30 16:25:08.572371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 396/791] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:08 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:08.574162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.574665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.575109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.575852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.576314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.576747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.705209 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:08.712892 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ab5f4dd2-9fe0-4b19-aadb-d3340e97e639 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.152045 Aug 30 16:25:08.713475 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 396/792] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:08 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:09.592922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:09.593688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:09.595854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:09.596496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:09.603642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.604142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.604621 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.605378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.605843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.606462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.683683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:09.693865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06fd1b20-d9e7-4c2f-bcbc-d3ce385f79ee tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1623 microversion: 2.1 time: 0.104751 Aug 30 16:25:09.694459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 397/793] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:09 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1623 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:09.734284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:09.734887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:09.737697 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:09.744664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.744912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.745333 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.746052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.746517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.747665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.826805 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e00a1dc-6a4c-4d96-88eb-413a7bdf9058", "name": "network-vif-deleted", "tag": "68dd1cbe-341d-4d52-844a-d12894417b32"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:09.836466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.836947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.837387 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.850016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] Creating event network-vif-deleted:68dd1cbe-341d-4d52-844a-d12894417b32 for instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 on hv-cinder-85220 Aug 30 16:25:09.855711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9b1afd43-c6cd-4088-a971-9671e23685fd req-4342d2a9-8dc6-404b-925c-04165e2e09cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032880 Aug 30 16:25:09.857134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 398/794] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:09.915836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:09.924639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a7e67ef2-9088-4ee0-9208-15f8cd00ac01 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1362 microversion: 2.1 time: 0.193813 Aug 30 16:25:09.925518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 397/795] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:09 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:10.716139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:10.716873 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:10.724584 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.725090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.725541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.726275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.726743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.727181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.764123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.764618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.765065 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.765525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lazy-loading 'fault' on Instance uuid 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:10.768803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:10.841500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:10.849948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23ac99e8-a110-4642-8610-3c713daa8c30 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 200 len: 1336 microversion: 2.1 time: 0.138653 Aug 30 16:25:10.850862 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 399/796] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:10 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 1336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:10.946379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:10.947090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:10.953926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.954429 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.954865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.955722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.956136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.956564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.086244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:11.094028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-519f326a-b158-4853-985d-0ba128a1e0b9 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1549 microversion: 2.1 time: 0.151712 Aug 30 16:25:11.094598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 398/797] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:10 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:11.115413 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:11.115919 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:11.121967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.122458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.122906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.123639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.124104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.124533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.204016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfde5f60-5373-40e5-999b-a3aa3b9ed6f3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093309 Aug 30 16:25:11.204623 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 400/798] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:25:11 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:11.874036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:11.874658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:11.881999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.881999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.881999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.883669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.884140 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.884571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.900462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] HTTP exception thrown: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Request method failure captured: Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 HTTP/1.1 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgT2xKprBMSu4MTqd9iOyiwhwW0Gm7-LBOAW5vKR3yfLujjpJH-57IXRTpkINxVTEp7zVacc40uGiS6k3Mqd18Wg9VmpDUprnTYADlu4Z2LZlENE9UL1_Tcoru1jwOmOhFrvlDxwPd0W0iNirFw1eLHjC80X6tKouYTnAr4C8hHO5Q Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:25:11.902193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dff1326e1026492080d292aa3a157366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dff1326e1026492080d292aa3a157366"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}] Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 03eed7086183469f8cc1e765422bea87 Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. Aug 30 16:25:11.903978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '5e00a1dc-6a4c-4d96-88eb-413a7bdf9058'} Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:25:11.904771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. Aug 30 16:25:11.905965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:25:11.907065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Returning 404 to user: Instance 5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:25:11.907065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-37244bea-eacf-4dcb-a936-5eb2d192aa68 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058" status: 404 len: 111 microversion: 2.1 time: 0.033620 Aug 30 16:25:11.907065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 399/799] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:11 2022] GET /compute/v2.1/servers/5e00a1dc-6a4c-4d96-88eb-413a7bdf9058 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:25:11.913634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7190205-fa0b-4e42-a296-21cc86739c1b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '.version_select at 0x7f1266b691f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:11.934336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7190205-fa0b-4e42-a296-21cc86739c1b tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122095888" status: 202 len: 0 microversion: 2.1 time: 0.025073 Aug 30 16:25:11.934936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 401/800] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 30 16:25:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122095888 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:12.250649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e22c005-ce81-45fd-8b26-b89896b4d035", "tag": "da28c5bc-b832-4c65-8b00-6d58528cf74b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:12.264711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:12.265484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:12.266831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:12.285912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] Creating event network-changed:da28c5bc-b832-4c65-8b00-6d58528cf74b for instance 7e22c005-ce81-45fd-8b26-b89896b4d035 on hv-cinder-85220 Aug 30 16:25:12.293114 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-d2c97d14-83df-4436-9ca2-7e6e32ac3905 req-ce06d218-126c-4579-bd24-679a898ea67c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045616 Aug 30 16:25:12.295168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 400/801] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:15.182551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:15.183084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:15.188987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.190114 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.190569 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.191289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.191752 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.192180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.217110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:15.295571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81f58646-71d6-4638-a9fa-5e69be0223d8 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 204 len: 0 microversion: 2.1 time: 0.117039 Aug 30 16:25:15.296622 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 402/802] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:25:15 2022] DELETE /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:25:15.305374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:15.306072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:15.312907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.313394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.313823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.314562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.315012 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.315491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.448975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:15.457708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7068fb7c-fba6-4821-aaa0-a4d81f162b7a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1507 microversion: 2.1 time: 0.156418 Aug 30 16:25:15.458279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 401/803] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:15 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:16.396916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa19fe1-b789-43c1-8471-ee231a65cc92", "name": "network-vif-deleted", "tag": "4955ad3e-aca3-4c8e-860c-51796f3b6f8d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:16.407338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.408385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.408852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.423537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] Creating event network-vif-deleted:4955ad3e-aca3-4c8e-860c-51796f3b6f8d for instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 on hv-cinder-85220 Aug 30 16:25:16.429928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e5b298bb-f056-45ee-8929-d96dd6dc9f81 req-8b0d131a-08e1-446e-849e-cbdfc1c6fd17 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Aug 30 16:25:16.430608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 403/804] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:16.478215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:16.479558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:16.486175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.487361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.487805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.488503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.488989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.489413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.555882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:16.563773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8be4f5c8-6a7e-4fe3-b04b-2e03a9ccf264 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 200 len: 1293 microversion: 2.1 time: 0.089679 Aug 30 16:25:16.565140 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 402/805] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:16 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:17.586552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:17.587307 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 4aa19fe1-b789-43c1-8471-ee231a65cc92] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:17.593659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.594142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.594585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.595302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.595769 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.596198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.609911 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] HTTP exception thrown: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Request method failure captured: Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 HTTP/1.1 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgT2xKprBMSu4MTqd9iOyiwhwW0Gm7-LBOAW5vKR3yfLujjpJH-57IXRTpkINxVTEp7zVacc40uGiS6k3Mqd18Wg9VmpDUprnTYADlu4Z2LZlENE9UL1_Tcoru1jwOmOhFrvlDxwPd0W0iNirFw1eLHjC80X6tKouYTnAr4C8hHO5Q Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:25:17.611604 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dff1326e1026492080d292aa3a157366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dff1326e1026492080d292aa3a157366"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}] Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 03eed7086183469f8cc1e765422bea87 Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. Aug 30 16:25:17.613179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '4aa19fe1-b789-43c1-8471-ee231a65cc92'} Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:25:17.613982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. Aug 30 16:25:17.615619 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:17.617103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Returning 404 to user: Instance 4aa19fe1-b789-43c1-8471-ee231a65cc92 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:25:17.617103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-897abf9a-cc10-4dfb-a0fe-52ab4938ef15 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92" status: 404 len: 111 microversion: 2.1 time: 0.031223 Aug 30 16:25:17.617103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 404/806] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:17 2022] GET /compute/v2.1/servers/4aa19fe1-b789-43c1-8471-ee231a65cc92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:25:17.621640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:17.622148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:17.629465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.629945 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.630395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.631133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.631680 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.632112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.658640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:17.732601 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b420a484-2534-488f-b37e-6bbeb01f511a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 204 len: 0 microversion: 2.1 time: 0.114553 Aug 30 16:25:17.733188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 403/807] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:25:17 2022] DELETE /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:25:17.741711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:17.742557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:17.748560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.749046 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.749569 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.750263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:17.750723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:17.751151 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:17.884210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:17.892061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07081835-b2e4-4acb-afbb-3dce2c59737a tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1521 microversion: 2.1 time: 0.154166 Aug 30 16:25:17.893270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 405/808] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:17 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:18.914127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:18.915653 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:18.924202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.924700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.925392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.926443 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.927063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.927663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.984565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7002e560-8234-4472-94da-e854fa3aa36c", "name": "network-vif-deleted", "tag": "d5153690-2d32-45c8-8e23-5a0c2efd672c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:18.997764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.998342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.998860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:19.015404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] Creating event network-vif-deleted:d5153690-2d32-45c8-8e23-5a0c2efd672c for instance 7002e560-8234-4472-94da-e854fa3aa36c on hv-cinder-85220 Aug 30 16:25:19.021168 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4cc4c9b0-5838-4a46-a53d-eccf312ec812 req-9e987881-58a5-4693-9f23-cc8000b8cdcd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041686 Aug 30 16:25:19.021893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 406/809] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:19.035155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03eed7086183469f8cc1e765422bea87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1326e1026492080d292aa3a157366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:19.046723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-85e5bdc1-106c-4b9f-bc1c-39e940f3e732 tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 200 len: 1479 microversion: 2.1 time: 0.137651 Aug 30 16:25:19.051733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 404/810] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:18 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 1479 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:20.068035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:20.068740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] [instance: 7002e560-8234-4472-94da-e854fa3aa36c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:20.074921 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:20.075445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:20.075889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:20.076616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:20.077074 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:20.077501 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:20.090716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] HTTP exception thrown: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Request method failure captured: Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c HTTP/1.1 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgT2xKprBMSu4MTqd9iOyiwhwW0Gm7-LBOAW5vKR3yfLujjpJH-57IXRTpkINxVTEp7zVacc40uGiS6k3Mqd18Wg9VmpDUprnTYADlu4Z2LZlENE9UL1_Tcoru1jwOmOhFrvlDxwPd0W0iNirFw1eLHjC80X6tKouYTnAr4C8hHO5Q Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:25:20.092362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_dff1326e1026492080d292aa3a157366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/dff1326e1026492080d292aa3a157366"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/dff1326e1026492080d292aa3a157366"}]}] Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: dff1326e1026492080d292aa3a157366 Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011856864 Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 03eed7086183469f8cc1e765422bea87 Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011856864-project Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. Aug 30 16:25:20.094110 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '7002e560-8234-4472-94da-e854fa3aa36c'} Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:25:20.096418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. Aug 30 16:25:20.097682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:25:20.098894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] Returning 404 to user: Instance 7002e560-8234-4472-94da-e854fa3aa36c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:25:20.098894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64334444-1889-42f8-90d2-80f90ce6e46f tempest-ServerRescueNegativeTestJSON-2011856864 tempest-ServerRescueNegativeTestJSON-2011856864-project] 10.222.0.57 "GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c" status: 404 len: 111 microversion: 2.1 time: 0.030608 Aug 30 16:25:20.098894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 407/811] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:20 2022] GET /compute/v2.1/servers/7002e560-8234-4472-94da-e854fa3aa36c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:25:29.186782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:29.188314 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:29.361398 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ec5452a5-7580-423a-a274-7c5ca1236799 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: .version_select at 0x7f1266a8e820>, body: {"keypair": {"name": "tempest-keypair-761238323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFSBX7JRasjY3wFGHn1FA4WArpWvfl6FOkI5JlpFcdS3k1NZqWfcIPsLqpxceiafABE/jOu2RMSjg2fKUhzcSDs8a+06mXXR1Ac2BYseHzbI6UnWxZwFNnn9C5yFuAWaA=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:29.379201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-ec5452a5-7580-423a-a274-7c5ca1236799 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:29.383312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-ec5452a5-7580-423a-a274-7c5ca1236799 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:29.406530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ec5452a5-7580-423a-a274-7c5ca1236799 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.225043 Aug 30 16:25:29.407310 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 405/812] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:25:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:30.814428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-715841601", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f01c0d68-8ce5-4320-b8be-3261ceb33308"}], "security_groups": [{"name": "tempest-securitygroup--2095069673"}], "key_name": "tempest-keypair-761238323", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:30.823460 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:30.824149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:30.928984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] validate_networks() for [('f01c0d68-8ce5-4320-b8be-3261ceb33308', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:25:31.321388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:25:31.321820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:25:31.322302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:25:31.322719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:25:31.323140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:25:31.332976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:31.333469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:31.333909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:31.334643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:31.335108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:31.335563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:31.352277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:31.356422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:31.368566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:25:31.370933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:25:31.424423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3f5d2aa-7f55-4dd0-a4f3-320f71d7a1b8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613643 Aug 30 16:25:31.425363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 408/813] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:25:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:25:31.436589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bccc8c4e-7450-405d-8611-f85fa7585e77 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:31.437295 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bccc8c4e-7450-405d-8611-f85fa7585e77 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:31.493972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bccc8c4e-7450-405d-8611-f85fa7585e77 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:31.501938 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bccc8c4e-7450-405d-8611-f85fa7585e77 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1240 microversion: 2.1 time: 0.069736 Aug 30 16:25:31.507063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 406/814] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:31 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:32.523958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:32.524741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:32.532616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:32.535195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:32.535852 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:32.536757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:32.537366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:32.537799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:32.603732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:32.612427 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf105f12-2d57-4629-9dbf-8497beb2ab4e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1292 microversion: 2.1 time: 0.092769 Aug 30 16:25:32.612936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 409/815] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:32 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:33.632719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:33.633344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:33.639991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:33.640485 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:33.645761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:33.646623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:33.647055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:33.647509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:33.897277 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:33.906253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3facef8d-a509-4202-bfcf-f5ff69a0cb72 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.277588 Aug 30 16:25:33.907099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 407/816] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:33 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:34.395660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986d0c22-4e47-46ab-a363-cc3371b6b4de", "tag": "6e5fae51-833d-4af6-bc0a-2c3172988e35"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:34.407646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:34.419608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:34.420174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:34.432458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] Creating event network-changed:6e5fae51-833d-4af6-bc0a-2c3172988e35 for instance 986d0c22-4e47-46ab-a363-cc3371b6b4de on hv-cinder-85220 Aug 30 16:25:34.437447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-033f98a9-0ff8-4100-bbc8-7e6ab9466bb0 req-a814e2b7-76a1-4c5d-936e-d03a73054337 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046329 Aug 30 16:25:34.438320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 410/817] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:34.928749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:34.929386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:34.935727 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:34.936206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:34.936644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:34.937362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:34.937816 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:34.938241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.073385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:35.081021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-89317b6a-c8ed-4271-bda6-e4d523267585 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.156833 Aug 30 16:25:35.081591 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 408/818] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:34 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:36.102354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:36.102966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:36.109283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.109770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.110209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.110903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.111892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.112321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.244173 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:36.252581 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea0d798a-a7a0-48a9-b0f8-99e8f32ebb57 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.154432 Aug 30 16:25:36.253178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 411/819] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:36 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:37.274203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:37.274747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:37.281148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.281632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.282068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.282755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.283322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.283755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.493385 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:37.501042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1e1c1a09-9095-4e12-b9d3-6af5ac5b8875 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.230771 Aug 30 16:25:37.501639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 409/820] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:37 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:37.686325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:37.687509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:37.694514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.695597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.696277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.697202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.697951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.698627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.724155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f77d4917-8aac-46a7-a399-f1c0871357e5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/ips" status: 200 len: 153 microversion: 2.20 time: 0.041784 Aug 30 16:25:37.724746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 412/821] 10.222.0.57 () {60 vars in 1289 bytes} [Tue Aug 30 16:25:37 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:25:38.522504 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:38.523129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:38.529577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.530065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.530505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.531197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.531748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.532173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.666025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:38.673608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-eee6b7d3-12d2-477e-8788-31404362934f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.155031 Aug 30 16:25:38.674172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 410/822] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:38 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:39.119641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986d0c22-4e47-46ab-a363-cc3371b6b4de", "name": "network-vif-plugged", "status": "completed", "tag": "6e5fae51-833d-4af6-bc0a-2c3172988e35"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:39.130835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.131351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.131789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.143131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] Creating event network-vif-plugged:6e5fae51-833d-4af6-bc0a-2c3172988e35 for instance 986d0c22-4e47-46ab-a363-cc3371b6b4de on hv-cinder-85220 Aug 30 16:25:39.148376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6b38ca9f-06e2-45bf-a36e-c4b084dcb853 req-68badf58-4d5f-48e7-8b4b-e7fd9dcfe0f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032308 Aug 30 16:25:39.149372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 413/823] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:39.693940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:39.694556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:39.701267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.701757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.702199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.702898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.703393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.703828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.832024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.839726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-152a84e1-07aa-4f08-9202-bb43db49cf2f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.149636 Aug 30 16:25:39.840298 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 411/824] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:39 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:40.036378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:40.037031 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.043306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.043794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.044237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.044932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.045393 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.045823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.070705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lazy-loading 'flavor' on Instance uuid 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:40.247719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90a9d41c-fc79-41d2-b155-86442cbf6099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/action" status: 202 len: 0 microversion: 2.20 time: 0.216105 Aug 30 16:25:40.248874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 414/825] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 30 16:25:40 2022] POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:25:40.257767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:40.258411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.264451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.264953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.265370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.266064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.266548 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.266975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.401845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:40.410571 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:40.412068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:40.413242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a3d55c72-4e2b-40ad-9e6a-fce9c48bd7e8 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.159601 Aug 30 16:25:40.413839 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 412/826] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:40 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:40.862189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:40.862882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.869123 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.869608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.870051 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.870751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.871208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.871662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.012737 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.020469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-786906d3-bf5e-4829-8697-1aeec54431da tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1366 microversion: 2.1 time: 0.163138 Aug 30 16:25:41.021038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 415/827] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:40 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:41.436552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:41.437152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:41.443538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:41.444016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:41.444447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.445127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:41.445577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:41.445996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.501357 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:41.581299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.589386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.590829 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.592014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5ec186b6-1099-446f-9f68-6e32e14fd23a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.159432 Aug 30 16:25:41.592577 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 413/828] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:41 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:42.041820 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:42.042457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:42.044938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:42.045533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:42.051740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.052219 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.052657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.053351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.053804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.054223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.183584 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.192092 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a35f898-f7f0-4c72-a8eb-c2153f9eb175 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1556 microversion: 2.1 time: 0.154125 Aug 30 16:25:42.192665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 416/829] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:42 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:42.211897 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:42.212390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:42.218381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.218861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.219322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.220012 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.220510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.220931 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.297705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-907a5217-8382-42ed-99dc-b07bfbf6dc9b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089431 Aug 30 16:25:42.298366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 414/830] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:25:42 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:42.615502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:42.616020 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:42.622184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.622683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.623132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.623903 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.624367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.624800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.768028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.776700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.778158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.779371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-551fab5c-5f1e-4cd6-9b40-6a1924b9db2e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.168791 Aug 30 16:25:42.779950 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 417/831] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:42 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:43.480241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986d0c22-4e47-46ab-a363-cc3371b6b4de", "tag": "6e5fae51-833d-4af6-bc0a-2c3172988e35"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:43.491012 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.491734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.492376 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.504501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] Creating event network-changed:6e5fae51-833d-4af6-bc0a-2c3172988e35 for instance 986d0c22-4e47-46ab-a363-cc3371b6b4de on hv-cinder-85220 Aug 30 16:25:43.509913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-2c6f5ee5-18f8-4150-b999-0325bcb1281e req-14473112-925d-42d4-8479-9a0019dbf56d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034023 Aug 30 16:25:43.510708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 415/832] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:43.803705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:43.804318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:43.810752 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.811267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.811706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.812397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.813036 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.813455 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.956714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:43.965979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:43.967435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:43.968618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5d57e45-5106-4358-8be6-41417f397648 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.169602 Aug 30 16:25:43.969314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 418/833] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:43 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:44.992718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:44.993417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:44.999710 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.000200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.000682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.001333 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.002434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.002864 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.135465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.143617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.145081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.146249 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2fdb33af-2822-4abf-bbd2-7354d023f956 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.157971 Aug 30 16:25:45.146822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 416/834] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:44 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:46.169109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:46.169728 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:46.176391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.176877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.177317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.178027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.178478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.178906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.308808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.317708 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.319158 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.320358 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef961eec-76ef-475d-9fb7-864570fef784 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.155230 Aug 30 16:25:46.320925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 419/835] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:46 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:47.344071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:47.344684 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:47.353655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.354146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.354702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.355757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.356259 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.356651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.506869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.515892 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.518171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.519452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9147f41d-2dc9-4ca5-bf82-dbc4197ae636 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.179293 Aug 30 16:25:47.520027 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 417/836] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:47 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:48.543367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.543986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.551342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.551837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.552279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.552982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.553448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.553882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.688402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.696457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.697922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.699091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0b5ac61-a442-4f9a-88ac-bfc45687cbf9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.159744 Aug 30 16:25:48.699697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 420/837] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:49.722030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:49.722661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:49.729247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:49.729726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:49.730216 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:49.730849 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:49.731330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:49.731751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:49.858918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.867885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.869359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.870533 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8a1506cf-147f-416a-bed4-109e8c69973a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.152526 Aug 30 16:25:49.871098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 418/838] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:49 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:50.894746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:50.895338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:50.901718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.902199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.902631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.903349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.903802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.904225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.033164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:51.041257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:51.042698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:51.043878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-754d1855-bd1d-4b57-8685-b2f8ea1fb5f5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.153854 Aug 30 16:25:51.044445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 421/839] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:50 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:52.067547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:52.068162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:52.074706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.075194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.075665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.076359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.076820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.077254 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.208975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.217068 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.218530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.219729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2c0baee2-2bf6-461c-81f4-fbc852abb8e7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.156715 Aug 30 16:25:52.220293 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 419/840] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:52 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:53.243008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.243665 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.250244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.250739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.251187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.251944 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.253016 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.253466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.391047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.399960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.402363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.403611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15a1004c-15cd-4c63-825f-3898c6c934e4 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.164597 Aug 30 16:25:53.404351 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 422/841] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:53 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:54.426206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.426820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.433441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.433928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.434370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.435075 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.435562 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.435995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.567338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:54.575151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:54.576636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:54.577798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b278428f-e967-4c0f-94d2-df68675f282a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.155593 Aug 30 16:25:54.578365 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 420/842] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:54 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:55.183084 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "name": "network-vif-plugged", "status": "completed", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:55.194175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.194648 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.195088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.206280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] Creating event network-vif-plugged:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:25:55.211292 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-90ae8c1f-17f2-40ae-a21a-82b1187c28f8 req-87273521-57e7-4fdc-9258-a3d840a38d64 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Aug 30 16:25:55.211916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 423/843] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:55.602374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.602983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.609522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.610013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.610455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.611150 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.611652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.612087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.740442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:55.748649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:55.750113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:55.751302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c7adf1a3-9ef6-4e62-a246-4fc2f358523e tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.152847 Aug 30 16:25:55.751867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 421/844] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:55 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:56.776353 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:56.777057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:56.788687 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.789577 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.790316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.791037 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.791545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.791981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.939806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.948010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.949454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.950616 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-323773bf-7d55-4b40-8af7-dc1a3cdb36a5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.179968 Aug 30 16:25:56.951182 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 424/845] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:56 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:57.973948 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:57.974596 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:57.981134 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.981620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.982064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.982770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.983239 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.983692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:58.117682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.125732 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.127693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.128867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c4ecf9fc-7355-4858-967e-7a97174eef0f tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1745 microversion: 2.20 time: 0.158849 Aug 30 16:25:58.129693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 422/846] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:57 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:59.153610 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:59.154985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:59.164739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.165232 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.165679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.166779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.167892 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.168144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.192281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:59.316768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.324958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.326434 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.327633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29d2c0e3-300d-4096-bbac-828cd14a6f69 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.179015 Aug 30 16:25:59.342894 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 425/847] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:59 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:00.350955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:00.351850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:00.354390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:00.362733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.363441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.363909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.364847 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.365317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.365937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.369926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=91 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:00.512693 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:00.530880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:00.532452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:00.533655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bcfb4088-8fc2-4cc6-9223-c2d80cadf01d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.186748 Aug 30 16:26:00.534453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 423/848] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:00 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:01.558812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:01.559502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:01.561986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:01.568228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.568918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.569504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.570471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.571163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.571747 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.752764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:01.761808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:01.763265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:01.764427 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9603f28-fa9d-4ea0-978b-fcc9b5c216d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.209990 Aug 30 16:26:01.764997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 426/849] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:01 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:02.788308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:02.789165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:02.796227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:02.796811 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:02.797328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:02.798120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:02.798650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:02.799152 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:02.949293 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:02.958652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:02.960142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:02.961373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ffdca09b-4cfe-4656-bf0c-ba18f9024b39 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.177529 Aug 30 16:26:02.961913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 424/850] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:02 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:03.985100 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:03.986533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:03.994306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.995245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.996021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.996614 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.997139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.997627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:04.246017 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:04.266077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:04.269048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:04.272181 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25718a31-f99e-4cce-9cf2-a68e4fc81c95 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.291245 Aug 30 16:26:04.274509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 427/851] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:03 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:05.298379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:05.299984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:05.306997 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.307629 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.308280 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.309082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.309762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.310287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.467841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.478377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.479974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.481539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9c04adf9-0be9-42a6-91bd-c6c58dfd35d6 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.187163 Aug 30 16:26:05.482241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 425/852] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:05 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:06.505940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:06.506583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:06.513055 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.513547 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.513990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.514692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.515185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.515647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.679891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.692509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.694211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.696837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a4612d6-1b4a-433e-9fe7-7f19ad5af93c tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.195674 Aug 30 16:26:06.697408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 428/853] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:06 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:07.719751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:07.720363 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:07.727756 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:07.728185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:07.728626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:07.729332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:07.729802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:07.730242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:07.880705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:07.890551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:07.892047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:07.893231 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-42f11bf3-f120-4cb6-a515-ab630f069782 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.177464 Aug 30 16:26:07.907441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 426/854] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:07 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:08.917670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:08.918258 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:08.924651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:08.925205 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:08.925642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:08.926325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:08.926780 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:08.927203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:09.055522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:09.063671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:09.065120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:09.066344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3df20c5-d3da-4e3a-b18a-4c62f0765526 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1740 microversion: 2.20 time: 0.152585 Aug 30 16:26:09.066906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 429/855] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:08 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:10.089755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:10.090372 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:10.096799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.097820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.098269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.098985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.099477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.099911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.239998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.248133 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.249580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.250736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3a9f087e-72ce-4ea6-99bd-0ce28483cf9b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1722 microversion: 2.20 time: 0.165055 Aug 30 16:26:10.251346 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 427/856] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:10 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:11.273278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:11.273893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:11.280597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.281094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.281538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:11.282252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.282715 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.283144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:11.421485 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:11.430796 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:11.432266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:11.433431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68e71a53-c58d-42d0-92d6-1a0c4b1de932 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1722 microversion: 2.20 time: 0.164178 Aug 30 16:26:11.434038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 430/857] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:11 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:12.457462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:12.458082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:12.464652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.465149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.465588 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.466292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.466752 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.467183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.616304 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.624477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.625940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.627108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9c9b69fc-d295-4845-8b7b-842fc25da0ea tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1665 microversion: 2.20 time: 0.174321 Aug 30 16:26:12.627700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 428/858] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:12 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:12.650178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ace2fd2-b53a-4c77-8591-0735dae9f48f"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:12.652497 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:12.658380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.658866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.659333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.660028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.660493 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.660952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.941356 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07905633-1367-4715-8e9b-7c85a3d0d2cc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295259 Aug 30 16:26:12.942159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 431/859] 10.222.0.57 () {62 vars in 1364 bytes} [Tue Aug 30 16:26:12 2022] POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:26:13.064953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.065481 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.071508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.071992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.072427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.073122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.073573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.073996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.208145 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "name": "network-vif-unplugged", "status": "completed", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:13.222263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.222540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.223004 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.234506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.server_external_events [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] Unable to find a host for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83. Dropping event network-vif-unplugged {{(pid=120588) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 16:26:13.235362 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-df0a9e28-757e-44cc-8d7f-56929b853ffd req-a51785d7-6cda-4e36-bbd5-d6ae06fe72e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031468 Aug 30 16:26:13.235960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 432/860] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 16:26:13.306778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-818b27dc-83e9-41fb-8212-ea8004ccf240 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments/2ace2fd2-b53a-4c77-8591-0735dae9f48f" status: 202 len: 0 microversion: 2.20 time: 0.245635 Aug 30 16:26:13.307383 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 429/861] 10.222.0.57 () {60 vars in 1457 bytes} [Tue Aug 30 16:26:13 2022] DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments/2ace2fd2-b53a-4c77-8591-0735dae9f48f => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:26:13.367203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:13.367835 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.373882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.374370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.374812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.375537 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.375997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.376427 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.406133 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:26:13.471734 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0176d166-2758-42dc-bc85-c613fce6d2df tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/action" status: 202 len: 0 microversion: 2.20 time: 0.108828 Aug 30 16:26:13.472349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 433/862] 10.222.0.57 () {62 vars in 1319 bytes} [Tue Aug 30 16:26:13 2022] POST /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:26:13.480454 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.481054 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.488047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.488462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.488904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.489616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.490079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.490536 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.662261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.670585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.672057 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.673217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bda511c0-2834-4b0f-9539-d8c493f579f3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1673 microversion: 2.20 time: 0.196743 Aug 30 16:26:13.673806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 430/863] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:14.697834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:14.698497 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:14.704618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.705108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.705548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.706246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.707350 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.707790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.838042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.848011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.850169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.851398 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9f4f9f8-fb72-447a-92b8-aaed80c431c5 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.158263 Aug 30 16:26:14.851992 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 434/864] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:14 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:15.875433 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:15.876051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:15.883793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.884286 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.884725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.885444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.885900 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.886326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.044155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:16.052812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:16.054307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:16.055837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c01b8188-5d67-449e-99e0-63bc7d7a2b38 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.184487 Aug 30 16:26:16.056408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 431/865] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:15 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:17.077932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:17.078549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.085102 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.085593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.086038 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.086738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.087204 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.087664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.236560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.246096 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.247834 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.249226 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e896ee9-47f6-4918-ac6f-b18208937950 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.175118 Aug 30 16:26:17.257654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 435/866] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:17 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:18.275028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:18.275666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:18.282170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.282662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.283101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.283828 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.284288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.284716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.423788 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.432612 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.434126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.435271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-77b2d1f1-5fb3-414d-aeff-7e61fb603034 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.164432 Aug 30 16:26:18.435839 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 432/867] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:18 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:19.458447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:19.459898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:19.466570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.467059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.467524 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.468224 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.468752 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.469276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.614389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:19.623099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:19.625874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:19.627080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b0e15fe-149e-4439-8312-8332137e8099 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.173166 Aug 30 16:26:19.628007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 436/868] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:19 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:20.655830 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:20.657174 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:20.663911 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.664595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.665271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.665985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.666447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.666870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.830603 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:20.831735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:20.841654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.843449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.844076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.845649 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.846279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.846882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.849674 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.863778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.866329 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.876308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-33d648f3-88cf-4d0d-9c84-7ae2db7c4746 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.217714 Aug 30 16:26:20.876968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 433/869] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:20 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:20.880958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:20.882299 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:20.909241 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.909491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.909807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.933103 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] Creating event network-changed:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:26:20.939920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:20.940458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-0dcae803-fe83-4951-87e7-37803940827b req-97ee450d-88e4-4ca0-801f-5729cc8f784d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061497 Aug 30 16:26:20.941762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 434/870] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:20.982000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc84f67f-4390-4811-9af5-3d1ee1de68e1 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 204 len: 0 microversion: 2.1 time: 0.156029 Aug 30 16:26:20.992573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:20.993276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:20.997390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 437/871] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:26:20 2022] DELETE /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:26:21.007484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.008066 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.008519 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:21.009941 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.010482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.010921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:21.175165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:21.184106 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d060fece-e621-4c0a-88ab-1d6955ad5fab tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.196044 Aug 30 16:26:21.185560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 435/872] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:20 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:21.901308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:21.902691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:21.909883 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.910379 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.910824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:21.912098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.912564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.912994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.050092 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.058731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.060324 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.068516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96649cd8-36a2-44eb-8de7-008638b3dd1b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.164868 Aug 30 16:26:22.069534 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 438/873] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:21 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:22.208021 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:22.208798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:22.215244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.215752 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.216173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.216871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.217326 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.217749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.362966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.370964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b4fe0159-b3b4-41fc-a1d9-ba01318f1b71 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.168788 Aug 30 16:26:22.371777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 436/874] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:22 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:23.091349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.092075 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.099703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.100196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.100631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.101342 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.101792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.102216 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.251714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.260682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.262209 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.263407 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-548b9f0a-5316-4bc9-9e75-9f44cc33856a tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.175941 Aug 30 16:26:23.263985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 439/875] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:23.392264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.392879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.400090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.400635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.401023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.402157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.402157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.402597 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.550961 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.554898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:23.560654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e25ec42a-a1cd-4025-8588-6d19fd35b74e tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.172246 Aug 30 16:26:23.561508 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 437/876] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:24.287860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.288426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.295142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.295666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.296112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.296822 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.297282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.297717 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.438881 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.447236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.448749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.449967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba5cf93f-8531-48cd-929f-d9ffd5b88bd9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.166668 Aug 30 16:26:24.450587 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 440/877] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:24 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:24.584573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.585654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.596249 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.596751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.597198 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.597912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.599033 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.599496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.750364 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.758766 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6d04ea13-d09c-472e-9417-d92b253f84b3 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.179721 Aug 30 16:26:24.759710 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 438/878] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:24 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:25.472855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:25.474068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.482596 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.483352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.484098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.485105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.485817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.486430 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.631391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.639538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.641043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.642214 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db02dd72-bee9-4920-bbb2-1e343dec6f1d tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.173294 Aug 30 16:26:25.642781 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 441/879] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:25 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:25.780361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:25.780977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.787630 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.788113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.788551 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.789250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.789720 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.790144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.933264 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.941049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0dee694a-fbd3-406b-8370-392f216d4dd0 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.164525 Aug 30 16:26:25.941620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 439/880] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:25 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:26.665405 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:26.666027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:26.672512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.672997 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.673440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.674197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.674602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.675032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.805721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.814079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.815557 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.816718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82756291-e7d0-4417-9f8c-48f5edbdecdb tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.155336 Aug 30 16:26:26.817949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 442/881] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:26 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:26.962124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:26.962729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:26.969221 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.969708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.970143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.970833 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.971313 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.971733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.105379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.112926 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9707bd24-a3b3-41dc-88c5-1ab7ada5292a tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.154675 Aug 30 16:26:27.113491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 440/882] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:26 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:27.841276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:27.844006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:27.851679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.852578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.853024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.853751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.854176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.854598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.995081 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.003144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.005441 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.006597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f1c4433-5e78-49d1-ac98-0c5f7dcb5105 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.170312 Aug 30 16:26:28.007320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 443/883] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:27 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:28.134689 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:28.135327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:28.141740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.142224 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.142663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.143391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.143849 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.144284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.280025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.288158 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9032aa89-f693-4001-8410-3ba54b3418a7 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.157324 Aug 30 16:26:28.288736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 441/884] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:28 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:29.029829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:29.030632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:29.037019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.037510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.037954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.038655 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.039116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.039580 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.167953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.175908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.177841 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.178983 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75a95880-9eb8-427e-ad5d-d26be720107b tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.153058 Aug 30 16:26:29.179582 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 444/885] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:29 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:29.309738 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:29.310534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:29.318013 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.318491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.318922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.319649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.320101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.320524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.455649 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.463695 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-72719a1c-81fc-4e8e-8d12-bd2f54233de2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.157748 Aug 30 16:26:29.464288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 442/886] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:29 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:30.201777 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:30.202381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:30.208763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.209269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.209728 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.210414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.210865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.211319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.343432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.351936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.353381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.354541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d74d86c-211c-4dde-8507-b33fb0ced3a3 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.156704 Aug 30 16:26:30.355108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 445/887] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:30 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:30.486627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:30.487160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:30.489987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=40 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:30.495374 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.495864 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.496302 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.497003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.497461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.497887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.634614 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.642336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e3d5fb77-a10a-4ded-90b1-ab996f077473 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.159670 Aug 30 16:26:30.642912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 443/888] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:30 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:31.379117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.380015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:31.387083 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.387743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.388283 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.389080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.389448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.389875 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.570705 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.582956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.584801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.586197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ecc931f5-b907-47c2-b44f-74fdf9f9e906 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.210989 Aug 30 16:26:31.587278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 446/889] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:31 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:31.665036 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.665665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:31.672340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.672842 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.673270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.673970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.674424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.674850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.811370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.819638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-36d0c388-d39d-47d9-afc7-c1037fce2344 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1566 microversion: 2.1 time: 0.159101 Aug 30 16:26:31.820217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 444/890] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:31 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:32.440691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe265cd-29be-4514-a1d0-65f15799ff0d", "name": "network-vif-deleted", "tag": "a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:32.447193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:32.455160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.455697 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.456211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.471475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] Creating event network-vif-deleted:a0079d1f-2f5f-4e56-bbc6-43bc6be6eb86 for instance 4fe265cd-29be-4514-a1d0-65f15799ff0d on hv-cinder-85220 Aug 30 16:26:32.477454 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b23db806-1af5-4adf-84b1-a99252de9712 req-632a0fe7-f85b-44d1-9f4c-bc70a6420b51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040717 Aug 30 16:26:32.478077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 447/891] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:32.613899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.614618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.621584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.622708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.623157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.623940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.624546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.625093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.773003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.781642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.783111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.784350 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3a5fe4c5-c507-4315-aa7c-d6dbf16ad3ee tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.174416 Aug 30 16:26:32.784922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 445/892] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:32 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:32.841530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.842225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.848448 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.848930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.849366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.850716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.851189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.851671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.920491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af14713dfbb348fa8824570570225de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1fa996402448091ef05ed5b8467af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.928455 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5443a3bd-835a-4865-b127-065c6dc73bf2 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 200 len: 1219 microversion: 2.1 time: 0.091038 Aug 30 16:26:32.929193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 448/893] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:32 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:33.404059 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "name": "network-vif-plugged", "status": "completed", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:33.415472 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.416375 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.417029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.431651 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] Creating event network-vif-plugged:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:26:33.437630 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-ce8172d3-f857-48df-a920-b18704e980c8 req-af0c27f7-17ba-4b72-b648-33c255f617cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037227 Aug 30 16:26:33.439019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 446/894] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:33.808205 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:33.808916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:33.815347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.815830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.816261 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.816972 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.817423 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.817849 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.949440 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:33.950140 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] [instance: 4fe265cd-29be-4514-a1d0-65f15799ff0d] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:33.950817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.956863 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.957351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.957792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.958493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.958953 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.959409 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.959515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.961047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.962308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a00ab5a2-06c6-440e-ad1b-4e6b00920e91 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.157977 Aug 30 16:26:33.962942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 449/895] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:33 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:33.972817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] HTTP exception thrown: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Request method failure captured: Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d HTTP/1.1 Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjhsKAjpslhn1jdFPUR-fwRCWrstkmeEHvoZvDB00Wco-UUlamsM61KGDFejKEDGD8btpi0hC1ZYJkybvCAqcyqH4CIKfebj8Xk8L2FqhFpRvXVSom-XkI6zSB4yG3hslhzJ3ycDti38eK3_PPFx_ZdqeP8OYNvCboBIvytNji4ixXI Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 43a1fa996402448091ef05ed5b8467af Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-TestShelveInstance-817384496 Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:26:33.974958 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_43a1fa996402448091ef05ed5b8467af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/43a1fa996402448091ef05ed5b8467af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/43a1fa996402448091ef05ed5b8467af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/43a1fa996402448091ef05ed5b8467af"}]}] Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-TestShelveInstance-817384496 Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 43a1fa996402448091ef05ed5b8467af Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-TestShelveInstance-817384496 Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-TestShelveInstance-817384496-project Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: af14713dfbb348fa8824570570225de4 Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-TestShelveInstance-817384496-project Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. Aug 30 16:26:33.976743 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '4fe265cd-29be-4514-a1d0-65f15799ff0d'} Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:33.977708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. Aug 30 16:26:33.979323 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:26:33.980702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Returning 404 to user: Instance 4fe265cd-29be-4514-a1d0-65f15799ff0d could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:33.980702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-dfbaea79-5c67-4db6-908d-734f8a8e37bd tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d" status: 404 len: 111 microversion: 2.1 time: 0.031153 Aug 30 16:26:33.980702 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 447/896] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:33 2022] GET /compute/v2.1/servers/4fe265cd-29be-4514-a1d0-65f15799ff0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:26:34.143264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94c93704-25d7-459d-aeee-a29c69e20f23 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] Calling method '.version_select at 0x7f1266b65790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.165019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94c93704-25d7-459d-aeee-a29c69e20f23 tempest-TestShelveInstance-817384496 tempest-TestShelveInstance-817384496-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1440648328" status: 202 len: 0 microversion: 2.1 time: 0.025602 Aug 30 16:26:34.165708 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 450/897] 10.222.0.57 () {58 vars in 1254 bytes} [Tue Aug 30 16:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1440648328 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:26:34.985770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.986370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.992936 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.993426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.993865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.994568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.995028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.995482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.136441 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.149845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.151701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.153002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-dc58c6b8-621c-47d6-918e-13b641667224 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1731 microversion: 2.20 time: 0.171201 Aug 30 16:26:35.153668 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 448/898] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:34 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:36.184515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:36.185152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:36.191184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.191650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.192224 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.192940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.193890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.194321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.453317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:36.462606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:36.464079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:36.465242 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfd4f45a-1aa1-40f5-a3b4-b71b9aa4e366 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1718 microversion: 2.20 time: 0.292471 Aug 30 16:26:36.465815 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 451/899] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:36 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1718 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:38.799975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:38.800537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:38.806851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.807370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.807809 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.808515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.808971 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.809395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.832904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-089c5b79-58b9-464a-a4b9-07aed1794ea3 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/ips" status: 200 len: 147 microversion: 2.1 time: 0.036878 Aug 30 16:26:38.833489 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 449/900] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:26:38 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:40.198658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4df01f24-ba7e-4c94-8c0e-b2a60d92efaa"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:40.206533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:40.214907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.215467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.215917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.216636 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.217103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.217533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.545003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c53aa92-a42d-49b1-8aeb-f3de1e210f43 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350067 Aug 30 16:26:40.546198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 452/901] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:26:40 2022] POST /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:48.117939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.120312 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.126598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.127093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.127584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.128287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.128756 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.129186 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.159521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2cec75df-3fd1-48cd-95ed-1714930c3822 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Aug 30 16:26:48.160084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 450/902] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:48.172728 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.173352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.180315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.180809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.181254 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.181949 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.182408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.182838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.211363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-287f330d-b137-45a8-bdd6-155cdd2dfe1e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa" status: 200 len: 194 microversion: 2.1 time: 0.043809 Aug 30 16:26:48.211954 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 453/903] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:49.550267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2230481e-0e64-43af-8ee8-d1eb4ae50e8e"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:49.553148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:49.559598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.560097 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.560537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.561238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.561700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.562132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.798677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-aebe866a-6955-4ea4-960e-7faa67ce3c30 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "POST /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252167 Aug 30 16:26:49.799317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 451/904] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:26:49 2022] POST /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:57.318489 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:57.320789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:57.327213 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.327739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.328184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.329013 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.329343 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.329770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.332266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:57.362511 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-feaa2c2d-b3e1-4fc4-83d1-5d001eec7902 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047893 Aug 30 16:26:57.363068 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 454/905] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:57 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:57.504109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:57.504946 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:57.511257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.511741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.512183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.512884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.513339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.513761 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.516285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:57.546173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bbd6f38f-c46c-44e2-9886-35cae9a0f7c2 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa" status: 200 len: 194 microversion: 2.1 time: 0.046953 Aug 30 16:26:57.546749 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 452/906] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:57 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:57.556974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:57.557505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:57.563418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.563906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.564345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.565041 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.565496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.565922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.646473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lazy-loading 'services' on Instance uuid 7e22c005-ce81-45fd-8b26-b89896b4d035 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:57.718938 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccae53a9-766c-4428-8b2a-7dd8790e033f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa" status: 202 len: 0 microversion: 2.1 time: 0.165751 Aug 30 16:26:57.719729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 455/907] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:26:57 2022] DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/4df01f24-ba7e-4c94-8c0e-b2a60d92efaa => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:58.838389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:58.838959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:58.845514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.845973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.846413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.847119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.847617 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.848044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.880127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3a0b0e56-934a-4b27-977b-f688156c0e74 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/2230481e-0e64-43af-8ee8-d1eb4ae50e8e" status: 200 len: 194 microversion: 2.1 time: 0.045231 Aug 30 16:26:58.880663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 453/908] 10.222.0.57 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:58 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/2230481e-0e64-43af-8ee8-d1eb4ae50e8e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:58.893898 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:58.894570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:58.900795 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.901288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.901732 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.902775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.902904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.903336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.982585 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lazy-loading 'services' on Instance uuid 7e22c005-ce81-45fd-8b26-b89896b4d035 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:59.054865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e08a6ae-24d5-4e8e-9c7e-77e502e3117e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/2230481e-0e64-43af-8ee8-d1eb4ae50e8e" status: 202 len: 0 microversion: 2.1 time: 0.165717 Aug 30 16:26:59.055506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 456/909] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:26:58 2022] DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments/2230481e-0e64-43af-8ee8-d1eb4ae50e8e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:00.225128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.227959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.234705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.235195 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.235669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.236366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.236823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.237257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.266643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a0cceb75-dd5c-4c9b-bf01-5b5947ece20a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045488 Aug 30 16:27:00.267191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 454/910] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:27:00 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:27:00.378469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.381011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.387291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.387783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.388223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.388917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.389374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.389804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.420352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a40e7726-638e-4c04-b437-1314e476fa6f tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046636 Aug 30 16:27:00.420924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 457/911] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:27:00 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:27:00.481733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.482225 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.488229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.488707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.489138 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.489820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.490271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.490688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.515620 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:00.577610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=26 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:00.594806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0beeee94-0f96-4542-a897-306c726f4493 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 204 len: 0 microversion: 2.1 time: 0.116632 Aug 30 16:27:00.595487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 455/912] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:00 2022] DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:00.604513 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.605129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.611127 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.611700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.612143 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.612844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.613299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.613725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.893629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:00.901906 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-059f04a4-640e-43a9-8220-c58e988e3a04 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1674 microversion: 2.1 time: 0.301779 Aug 30 16:27:00.902399 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 458/913] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:00 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1674 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:01.923609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:01.924335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:01.931325 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.931810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.932239 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.932925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.933378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.933794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.062969 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:02.070765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e1c8f8b6-8ac1-4033-88f3-ba1facf43255 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1674 microversion: 2.1 time: 0.151360 Aug 30 16:27:02.071354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 456/914] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:01 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:03.092500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:03.093104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:03.095577 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:03.101889 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.102385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.102836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.103571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.104024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.104446 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.249611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.257764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ca0761a-2bc3-4202-a962-4d56b2af6fef tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1674 microversion: 2.1 time: 0.169175 Aug 30 16:27:03.258332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 459/915] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:03 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:03.902868 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e22c005-ce81-45fd-8b26-b89896b4d035", "name": "network-vif-deleted", "tag": "da28c5bc-b832-4c65-8b00-6d58528cf74b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:03.913592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.914065 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.914671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.926340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] Creating event network-vif-deleted:da28c5bc-b832-4c65-8b00-6d58528cf74b for instance 7e22c005-ce81-45fd-8b26-b89896b4d035 on hv-cinder-85220 Aug 30 16:27:03.932042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-6b478350-153b-45cd-8022-9060b21a02fb req-fb3a8dc0-4c02-4602-a298-28f564706836 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037885 Aug 30 16:27:03.932601 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 457/916] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:04.278431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:04.279185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:04.285807 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.286373 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.286886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.288246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.288714 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.289138 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.319851 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.320344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.320786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.321238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lazy-loading 'fault' on Instance uuid 7e22c005-ce81-45fd-8b26-b89896b4d035 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:04.671532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf0e8a3fae04b499310fe0d35c08269', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0d98b877d6458cb0e4c49dc8a57485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:04.678846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9963c652-9f80-4ff6-b9aa-58b79024de66 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 200 len: 1326 microversion: 2.1 time: 0.404206 Aug 30 16:27:04.679770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 460/917] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:04 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 1326 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:05.551026 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.551639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.557847 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.558339 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.558775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.559509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.559966 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.560389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.584148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e8552bd0-df27-4094-a816-d64e8aa7686e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/ips" status: 200 len: 149 microversion: 2.1 time: 0.037778 Aug 30 16:27:05.585420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 458/918] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:05.700790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.701664 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.708210 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.708753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.709197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.710499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.710960 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.711598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.725247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 HTTP/1.1 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:05.727005 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:05.728773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '7e22c005-ce81-45fd-8b26-b89896b4d035'} Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:05.729685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:05.731332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:05.733247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:05.733247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc0e6384-15cc-4617-a9b1-32b655ac4868 tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 404 len: 111 microversion: 2.1 time: 0.031889 Aug 30 16:27:05.733247 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 461/919] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:05.737898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d6fe6219-7318-42b1-82c1-44429772428e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '.version_select at 0x7f1266b9dc10>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.759101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d6fe6219-7318-42b1-82c1-44429772428e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650023416" status: 202 len: 0 microversion: 2.1 time: 0.025203 Aug 30 16:27:05.760104 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 459/920] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 30 16:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650023416 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:06.975637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "817b9afa-05b9-4968-9654-772f33dd05c7"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:06.977952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:06.984291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.984772 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.985203 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.985895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.986344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.986765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.224126 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da0e410a-b561-4138-97f2-6a9bf4184d61 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252591 Aug 30 16:27:07.224745 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 462/921] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:27:06 2022] POST /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:08.652639 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.653148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.659067 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.659598 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.660041 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.660741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.661229 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.661658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.675688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 HTTP/1.1 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:27:08.677406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.678784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '7e22c005-ce81-45fd-8b26-b89896b4d035'} Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:08.680182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.681760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.683294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:08.683294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-64e49298-9188-43d5-8e43-661422b6bb0c tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 404 len: 111 microversion: 2.1 time: 0.030524 Aug 30 16:27:08.683294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 460/922] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:08 2022] DELETE /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:08.689088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.689798 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 7e22c005-ce81-45fd-8b26-b89896b4d035] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.695974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.696463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.696908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.697634 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.698098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.698545 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.712064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 HTTP/1.1 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:08.713694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.715257 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '7e22c005-ce81-45fd-8b26-b89896b4d035'} Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:08.716090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. Aug 30 16:27:08.717522 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:08.718844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 7e22c005-ce81-45fd-8b26-b89896b4d035 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:08.718844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7c19aba-54b2-4d81-bb55-5296bde8365a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035" status: 404 len: 111 microversion: 2.1 time: 0.030779 Aug 30 16:27:08.718844 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 463/923] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:08 2022] GET /compute/v2.1/servers/7e22c005-ce81-45fd-8b26-b89896b4d035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:09.855368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.855937 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.862389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.862871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.863337 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.864039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.864497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.864947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.879173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae HTTP/1.1 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:27:09.881049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.882638 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '70cd69f5-b796-45fb-a89f-d7d39864d2ae'} Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:09.883510 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.884914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.886412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:09.886412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a04dfe43-2193-4780-abdc-0369e14c192e tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 404 len: 111 microversion: 2.1 time: 0.031668 Aug 30 16:27:09.886412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 461/924] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:09 2022] DELETE /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:09.892539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.893162 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] [instance: 70cd69f5-b796-45fb-a89f-d7d39864d2ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.899778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.900207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.900659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.901349 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.901814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.902276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.916137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] HTTP exception thrown: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Request method failure captured: Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae HTTP/1.1 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgTPqBAz6th352bAoTJU3EdEi6XHXtNW-bOj3__xttyfab83a0X9rELcf9HsZOVn7pD3smfClqxE91lr3-DxrXRpN9TdFlr1DRDzQYODQIuoUUO817wTTk9sm72I4i0ftDd7HYz93vaxBcWSH56hFWeNhGxylZyEKImHPmycfT9nX0 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:09.917639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1c0d98b877d6458cb0e4c49dc8a57485"}]}] Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 1c0d98b877d6458cb0e4c49dc8a57485 Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1478827917 Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ecf0e8a3fae04b499310fe0d35c08269 Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeTestJSON-1478827917-project Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.919156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '70cd69f5-b796-45fb-a89f-d7d39864d2ae'} Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:09.920080 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. Aug 30 16:27:09.921551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:09.922707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] Returning 404 to user: Instance 70cd69f5-b796-45fb-a89f-d7d39864d2ae could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:09.922707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dee991de-a8ba-430d-b76e-8453dfc1252a tempest-AttachVolumeTestJSON-1478827917 tempest-AttachVolumeTestJSON-1478827917-project] 10.222.0.57 "GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae" status: 404 len: 111 microversion: 2.1 time: 0.030574 Aug 30 16:27:09.922707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 464/925] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/70cd69f5-b796-45fb-a89f-d7d39864d2ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:14.483920 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-21f77ff6-6e51-4bbe-bae5-5201559b1d7e tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Action: 'create', calling method: .version_select at 0x7f12670d0e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1360214234", "metadata": {"Type": "work"}}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:14.790311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eeac0282-434f-40df-98d6-069dbcaa043d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: .version_select at 0x7f1266b1d1f0>, body: {"keypair": {"name": "tempest-keypair-736392320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmt1ilkfn9SK6aiff/bQAcYLEfTh1A71xLmlSVPck9HVUGAZJXPp4HuUBOj7jATs1YUmHSquUE28o2GgVGw5QcxFznrOP1evLFhtLIFWDawfyLblBZWvqeq59sBL5ZeWg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:14.808308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-eeac0282-434f-40df-98d6-069dbcaa043d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:14.812396 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-eeac0282-434f-40df-98d6-069dbcaa043d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:14.834644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eeac0282-434f-40df-98d6-069dbcaa043d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048364 Aug 30 16:27:14.835554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 465/926] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:27:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:14.922822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-21f77ff6-6e51-4bbe-bae5-5201559b1d7e tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.553055 Aug 30 16:27:14.923504 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 462/927] 10.222.0.57 () {60 vars in 1156 bytes} [Tue Aug 30 16:27:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 555 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 16:27:14.936730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2054a1d6-ba66-4166-9fa5-3a5d9fd3b609 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1266c20b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:14.997748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2054a1d6-ba66-4166-9fa5-3a5d9fd3b609 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 200 len: 353 microversion: 2.1 time: 0.064818 Aug 30 16:27:14.998323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 466/928] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:14 2022] GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:16.011949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ad797d7d-9eae-4703-bd08-26cd8116e67d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1266e3caf0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.065215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ad797d7d-9eae-4703-bd08-26cd8116e67d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 200 len: 354 microversion: 2.1 time: 0.057586 Aug 30 16:27:16.065810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 463/929] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:16.078164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8e68fe0-36d4-44ad-8fab-2b2aa0af2b82 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1266c81790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.130832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8e68fe0-36d4-44ad-8fab-2b2aa0af2b82 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 200 len: 354 microversion: 2.1 time: 0.056528 Aug 30 16:27:16.131464 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 467/930] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:16.134538 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2070556167", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f01c0d68-8ce5-4320-b8be-3261ceb33308"}], "security_groups": [{"name": "tempest-securitygroup--1979818127"}], "key_name": "tempest-keypair-736392320", "user_data": "}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:16.143836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94ab7a43-fb2a-409e-9873-7f2723d45e77 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1266f94dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.210262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94ab7a43-fb2a-409e-9873-7f2723d45e77 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 202 len: 0 microversion: 2.1 time: 0.070031 Aug 30 16:27:16.211745 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 468/931] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:27:16 2022] DELETE /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:16.219683 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7911f8d-643a-4ed3-a5a2-06621c9f3ce5 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1266bd2160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.252126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] validate_networks() for [('f01c0d68-8ce5-4320-b8be-3261ceb33308', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:27:16.268425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7911f8d-643a-4ed3-a5a2-06621c9f3ce5 tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 200 len: 353 microversion: 2.1 time: 0.052358 Aug 30 16:27:16.269017 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 469/932] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:16.640053 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:16.640484 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:16.640969 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:16.641381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:16.641823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:16.651327 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.651816 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.652251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.652989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.653449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.653880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.670376 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:16.674328 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:16.685373 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:16.687703 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:16.734781 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9d9c2bb3-47e4-47bc-895c-b62aaa921a6d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604942 Aug 30 16:27:16.735457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 464/933] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:27:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:27:16.746312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a2709c1-cd68-433d-b569-d7b4b35b5c02 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.746927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a2709c1-cd68-433d-b569-d7b4b35b5c02 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:16.806729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a2709c1-cd68-433d-b569-d7b4b35b5c02 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:16.813990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a2709c1-cd68-433d-b569-d7b4b35b5c02 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1241 microversion: 2.1 time: 0.071467 Aug 30 16:27:16.814565 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 470/934] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:17.282793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fb7fc87b-4b42-4626-a951-bec7c614197d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Calling method '.version_select at 0x7f1267058dc0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.312873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-fb7fc87b-4b42-4626-a951-bec7c614197d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] HTTP exception thrown: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fb7fc87b-4b42-4626-a951-bec7c614197d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Request method failure captured: Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 HTTP/1.1 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjpiVKcVhqYgZLZniiL5_ZxTd9OpTCgHXJ5d9ErGmQ91RLrxIdw5906XzUWpROVVCJ6wSH4VgCTWqNFnbKmwKel4Bd1RpmtzCSA01NRa6MNnQSZpQObSsq6sNIAOI3gOvc9E9MRXutt0421f-W0UjOjtOPDPqP9hokrQQs5gOXg1d7c Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 5e1395c40bbd42229b568a442627b886 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesGetTestJSON-1590408978 Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:27:17.314873 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5e1395c40bbd42229b568a442627b886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5e1395c40bbd42229b568a442627b886"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5e1395c40bbd42229b568a442627b886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5e1395c40bbd42229b568a442627b886"}]}] Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesGetTestJSON-1590408978 Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 5e1395c40bbd42229b568a442627b886 Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesGetTestJSON-1590408978 Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesGetTestJSON-1590408978-project Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 91e30cef85bf4c13a7f6af4045d0ca91 Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesGetTestJSON-1590408978-project Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'd847cc0a-9788-4987-ab78-a03ab8715c94'} Aug 30 16:27:17.316556 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. (HTTP 404) (Request-ID: req-d1366f5b-30ee-4edd-84fe-8d34da37e441) Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:17.317609 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:27:17.318841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:27:17.320760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fb7fc87b-4b42-4626-a951-bec7c614197d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] Returning 404 to user: Volume d847cc0a-9788-4987-ab78-a03ab8715c94 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fb7fc87b-4b42-4626-a951-bec7c614197d tempest-VolumesGetTestJSON-1590408978 tempest-VolumesGetTestJSON-1590408978-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94" status: 404 len: 109 microversion: 2.1 time: 0.038062 Aug 30 16:27:17.322559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 465/935] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/os-volumes/d847cc0a-9788-4987-ab78-a03ab8715c94 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:17.835313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.837364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.844301 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.844800 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.845244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.845953 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.846606 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.847263 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.915426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.923764 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-810ae356-8766-4edb-b79d-62afac2107b0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1311 microversion: 2.1 time: 0.092577 Aug 30 16:27:17.924647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 471/936] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:18.948573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.949345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.956482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.957261 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.957787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.959082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.959082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.959729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.185288 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:19.197736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-49a31322-43cb-49a3-87ef-17a1c17ec6a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.256366 Aug 30 16:27:19.214965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 466/937] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:19.428155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc69ca04-4867-4a3c-9f0b-cf2f13522101", "tag": "81fed6e5-5084-47d4-99d0-b484eb09c143"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:19.438336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:19.438843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:19.439293 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.450551 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] Creating event network-changed:81fed6e5-5084-47d4-99d0-b484eb09c143 for instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 on hv-cinder-85220 Aug 30 16:27:19.455640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-14a6b6f8-4d3e-4282-b8d0-13d8ef894f9e req-118abc26-bf4f-4e25-bca8-89d536b6f8c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Aug 30 16:27:19.456274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 472/938] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:20.229244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:20.229854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:20.236563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.237038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.237466 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.238186 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.238665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.239084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.307632 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33c6db18-6436-4bfb-a781-145f3ffe45a9 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266b84a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:20.356371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33c6db18-6436-4bfb-a781-145f3ffe45a9 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/79d3a286-eec0-41a5-822c-93d0b80fe6e3" status: 200 len: 351 microversion: 2.1 time: 0.053438 Aug 30 16:27:20.356957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 473/939] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:20 2022] GET /compute/v2.1/os-volumes/79d3a286-eec0-41a5-822c-93d0b80fe6e3 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:20.632544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.645129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-5004866c-b9ce-4b3b-a000-fd4e694964fe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.419908 Aug 30 16:27:20.645906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 467/940] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:20 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:21.666291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:21.667057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:21.673286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.673773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.674215 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.674909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.675401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.675836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.734755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-25f330cc-9230-4e7e-92a3-1a3bc63b4432 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266dd6e50>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:21.783782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-25f330cc-9230-4e7e-92a3-1a3bc63b4432 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/3821e33c-f7c5-4323-9933-a5db9844b0a2" status: 200 len: 350 microversion: 2.1 time: 0.052872 Aug 30 16:27:21.784453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 468/941] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:21 2022] GET /compute/v2.1/os-volumes/3821e33c-f7c5-4323-9933-a5db9844b0a2 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:21.812019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:21.819778 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-431e3bc4-4363-4bdb-b275-1e2fbb437e84 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.157803 Aug 30 16:27:21.820958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 474/942] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:21 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:22.842196 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:22.842820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:22.849502 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.849986 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.850452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.851243 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.851701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.852128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.980824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.988625 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8f2f9580-4f8c-4e0d-a5d4-793ebbdfc6b3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.150713 Aug 30 16:27:22.989189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 469/943] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:22 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:23.119830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2892cf1-ba3c-4766-b849-dd3d6e70d4dc tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266c41f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.166429 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2892cf1-ba3c-4766-b849-dd3d6e70d4dc tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/240d7a01-1887-48b9-a4a3-366708fccbf1" status: 200 len: 350 microversion: 2.1 time: 0.050953 Aug 30 16:27:23.167135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 475/944] 10.222.0.57 () {58 vars in 1245 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes/240d7a01-1887-48b9-a4a3-366708fccbf1 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:23.180124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d0c30426-e149-41f3-9d45-b69d708c6271 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f126712b550>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.261663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d0c30426-e149-41f3-9d45-b69d708c6271 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085999 Aug 30 16:27:23.262250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 470/945] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:23.276102 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1dca8829-be9d-42ee-9940-0a8b4e151fc7 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266b93a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.359432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1dca8829-be9d-42ee-9940-0a8b4e151fc7 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087136 Aug 30 16:27:23.360002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 476/946] 10.222.0.57 () {58 vars in 1149 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:23.374180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-107b9d8a-2cf4-4da6-9a6c-4f29fcbbda2f tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266dd6d30>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.460022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-107b9d8a-2cf4-4da6-9a6c-4f29fcbbda2f tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089964 Aug 30 16:27:23.460719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 471/947] 10.222.0.57 () {58 vars in 1134 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:23.473644 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4617baa6-b5bf-431a-8939-993b6d689b89 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266b84430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.557925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4617baa6-b5bf-431a-8939-993b6d689b89 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088159 Aug 30 16:27:23.558515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 477/948] 10.222.0.57 () {58 vars in 1167 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:23.571876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fd257574-d356-4a77-baef-64cdd066a580 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266c6bb80>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.664988 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fd257574-d356-4a77-baef-64cdd066a580 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.097082 Aug 30 16:27:23.665566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 472/949] 10.222.0.57 () {58 vars in 1170 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:23.679202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9246cf7-1460-4dbb-ba6e-b7a7ddda8454 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266b69790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.761093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9246cf7-1460-4dbb-ba6e-b7a7ddda8454 tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085632 Aug 30 16:27:23.761668 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 478/950] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:23.775125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b00595be-38b7-41d0-9948-466d0244384e tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266dd6310>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.862643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b00595be-38b7-41d0-9948-466d0244384e tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091765 Aug 30 16:27:23.863332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 473/951] 10.222.0.57 () {58 vars in 1188 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:23.875841 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb9d0d90-efa2-4579-ae83-e957caa8658f tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] Calling method '.version_select at 0x7f1266c41940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.960073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb9d0d90-efa2-4579-ae83-e957caa8658f tempest-VolumesTestJSON-34497743 tempest-VolumesTestJSON-34497743-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087908 Aug 30 16:27:23.961178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 479/952] 10.222.0.57 () {58 vars in 1155 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:24.010700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:24.011459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:24.019262 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.019956 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.020482 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.021377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.022055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.022622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.164654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.172336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ea09c6ee-44a8-428b-894f-b30829b09466 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.166862 Aug 30 16:27:24.172909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 474/953] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:24 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:25.194984 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:25.195642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:25.202220 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.202699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.203141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.203853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.204304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.204759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.336617 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:25.344466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ae640b9-ffb1-4375-9663-4aff2b8d71a8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.154046 Aug 30 16:27:25.345291 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 480/954] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:25 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:25.566998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69ca04-4867-4a3c-9f0b-cf2f13522101", "name": "network-vif-plugged", "status": "completed", "tag": "81fed6e5-5084-47d4-99d0-b484eb09c143"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:25.578582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.579099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.579561 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.592112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] Creating event network-vif-plugged:81fed6e5-5084-47d4-99d0-b484eb09c143 for instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 on hv-cinder-85220 Aug 30 16:27:25.597505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-18d8113f-3fb4-4c56-a745-74c84c1951a1 req-43728c8d-0db9-490e-9a3a-cbcba5af6b1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034012 Aug 30 16:27:25.598143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 475/955] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:26.365682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:26.366303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:26.373646 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.374132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.374575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.375306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.375773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.376206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.510155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.519760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ab8fb93-878c-445e-9b40-7d56176ac9fc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1367 microversion: 2.1 time: 0.157796 Aug 30 16:27:26.520461 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 481/956] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:26 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:27.540360 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.541623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.547791 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:27.549002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:27.562811 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.563340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.563948 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.565022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.565417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.565962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.588154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.711362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.720738 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6ec9be96-2b33-42c4-ac86-d6ad2ddbd1d5 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1557 microversion: 2.1 time: 0.182865 Aug 30 16:27:27.721449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 476/957] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:27 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1557 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:27.740611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:27.741134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:27.743586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.749645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.750137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.750578 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.751302 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.751765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.752192 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.756185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.859131 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-498921d9-a6d1-4337-a968-9a417be03978 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122268 Aug 30 16:27:27.859782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 482/958] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:27:27 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:29.046171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc69ca04-4867-4a3c-9f0b-cf2f13522101", "tag": "81fed6e5-5084-47d4-99d0-b484eb09c143"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:29.062153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.063023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.063721 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.081290 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] Creating event network-changed:81fed6e5-5084-47d4-99d0-b484eb09c143 for instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 on hv-cinder-85220 Aug 30 16:27:29.088748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-257e43c2-d2c9-49d6-82ea-a61c36e9f7fb req-95394336-d050-4da5-aeff-65f748108635 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047319 Aug 30 16:27:29.090030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 477/959] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:43.674931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:43.675746 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:43.680314 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.682431 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.689826 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.690318 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.690760 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.691488 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.691945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.692614 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.722974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d24aac2f-9c57-4392-a753-4a6d38f015a9 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049488 Aug 30 16:27:43.723567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 483/960] 10.222.0.57 () {60 vars in 1343 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:43.783129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:43.783902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=7 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:43.788015 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.788723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.796347 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.796831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.797265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.797965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.798420 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.798844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.826038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:43.901751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-91500ae2-7e1e-48fc-ab1e-442c91ccacef tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 204 len: 0 microversion: 2.20 time: 0.120216 Aug 30 16:27:43.902341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 478/961] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 30 16:27:43 2022] DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:27:43.918467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.919187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.925422 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.925882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.926333 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.927045 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.927535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.928466 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.060532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.068700 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.070156 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.071991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4e2b941-1f53-48d7-8674-37e2bf558b07 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.163669 Aug 30 16:27:44.072550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 484/962] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:45.094906 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:45.095547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:45.101542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.102030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.103025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.103757 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.104217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.104643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.259162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:45.267514 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:45.269044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:45.270221 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2a6f4f83-1625-419f-8519-c573e8a40c45 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.179945 Aug 30 16:27:45.270785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 479/963] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:45 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:46.294444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:46.295097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:46.301613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.302099 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.302531 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.303239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.303695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.304155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.440185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.448970 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.450416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3dc3a92c6424cdbb3a2d3c1baaa95e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07b587d6ac148b0a7751c851260b3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.451608 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab52c01c-1196-47d7-977b-5996953d4ed7 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 200 len: 1724 microversion: 2.20 time: 0.161631 Aug 30 16:27:46.452332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 485/964] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:46 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:46.779708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b99cdc-847a-40eb-8cc1-22fd2c1a3a83", "name": "network-vif-deleted", "tag": "2b06b0bf-85d2-4664-b9e6-9d60549a084d"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:46.794582 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.795073 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.795542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.809559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] Creating event network-vif-deleted:2b06b0bf-85d2-4664-b9e6-9d60549a084d for instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 on hv-cinder-85220 Aug 30 16:27:46.815158 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-dad68635-86e0-4107-a2af-70bbcf7f8086 req-0a3f7788-5bb4-4280-9c79-b65466e8535c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040000 Aug 30 16:27:46.816148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 480/965] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:47.475876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:47.477200 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:47.484762 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.485260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.485871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.486586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.487042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.487490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.503142 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 HTTP/1.1 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:47.505199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:47.506839 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '44b99cdc-847a-40eb-8cc1-22fd2c1a3a83'} Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:47.507672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:47.510010 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:47.511759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:47.511759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ac26dd9-0c86-42ea-89d9-9bb9e69b5817 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 404 len: 111 microversion: 2.20 time: 0.035789 Aug 30 16:27:47.511759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 486/966] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:47 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:47.517586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-604e8c93-d14b-4fff-9f8b-fa996e1757ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '.version_select at 0x7f1266dd63a0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:47.540594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-604e8c93-d14b-4fff-9f8b-fa996e1757ba tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342521177" status: 204 len: 0 microversion: 2.20 time: 0.027380 Aug 30 16:27:47.541452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 481/967] 10.222.0.57 () {60 vars in 1259 bytes} [Tue Aug 30 16:27:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342521177 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:27:49.390277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:49.390916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:49.397412 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.397897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.398337 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.399042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.399538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.399969 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.413303 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 HTTP/1.1 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:49.415385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '44b99cdc-847a-40eb-8cc1-22fd2c1a3a83'} Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:49.417990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.419499 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.421064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:49.421064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4abd6976-575e-46a2-b496-f1e0fdb24606 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 404 len: 111 microversion: 2.20 time: 0.031262 Aug 30 16:27:49.421064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 487/968] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 30 16:27:49 2022] DELETE /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:49.425592 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:49.426349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:49.433798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.434284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.434723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.435449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.435913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.436343 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.449640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 HTTP/1.1 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:27:49.451292 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.452939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '44b99cdc-847a-40eb-8cc1-22fd2c1a3a83'} Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:49.453764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. Aug 30 16:27:49.454999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:49.456124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance 44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:49.456124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6eebd40a-1bb2-491a-9442-71cafbefca26 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83" status: 404 len: 111 microversion: 2.20 time: 0.031441 Aug 30 16:27:49.456124 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 482/969] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:49 2022] GET /compute/v2.1/servers/44b99cdc-847a-40eb-8cc1-22fd2c1a3a83 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:27:50.595858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:50.596381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:50.602904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.604354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.604593 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.605304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.605765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.606199 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.619811 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac HTTP/1.1 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:27:50.621406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.623070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'bef6f406-1466-4883-bb22-2f778347bfac'} Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:50.623936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.625670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.628207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:50.628207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6768bfdf-59de-40e7-b3a8-62121c1c9cbc tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 404 len: 111 microversion: 2.20 time: 0.031337 Aug 30 16:27:50.628207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 488/970] 10.222.0.57 () {60 vars in 1280 bytes} [Tue Aug 30 16:27:50 2022] DELETE /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:50.631861 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:50.632473 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] [instance: bef6f406-1466-4883-bb22-2f778347bfac] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:50.639619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.640100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.640533 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.641242 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.641700 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.642125 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.656390 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] HTTP exception thrown: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Request method failure captured: Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac HTTP/1.1 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjgLiCvfnT6CPRiv9G1WW1E_eCL5wWruH80YSZFsN92fWuSJqPh1Ts0g7HarNfoe-V65akU2ifzlY8LD4hvhKj7u0hOTOmLCrNHC2Z036SC3mXbO7IkO-rAxOXewuLQmyI-r6xpVDKwweUnHbDds7hDpzol6zq80qAUbG_7TNB2DcZ0 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:27:50.657921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d07b587d6ac148b0a7751c851260b3bc"}]}] Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d07b587d6ac148b0a7751c851260b3bc Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1090797506 Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: c3dc3a92c6424cdbb3a2d3c1baaa95e3 Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1090797506-project Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.659762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'bef6f406-1466-4883-bb22-2f778347bfac'} Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:50.660682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. Aug 30 16:27:50.662157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:27:50.663513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] Returning 404 to user: Instance bef6f406-1466-4883-bb22-2f778347bfac could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:50.663513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-67980a64-322d-4e9b-bc19-3021d1a45d61 tempest-AttachVolumeShelveTestJSON-1090797506 tempest-AttachVolumeShelveTestJSON-1090797506-project] 10.222.0.57 "GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac" status: 404 len: 111 microversion: 2.20 time: 0.031845 Aug 30 16:27:50.663513 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 483/971] 10.222.0.57 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:50 2022] GET /compute/v2.1/servers/bef6f406-1466-4883-bb22-2f778347bfac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:56.730552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:56.731321 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=24 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:56.735824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:56.736323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:56.743035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.743553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.744000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.744690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.745148 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.745574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.769825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2787e61d-c845-4eb9-9b14-ae5848377e19 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/ips" status: 200 len: 150 microversion: 2.1 time: 0.040900 Aug 30 16:28:56.770385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 489/972] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:28:56 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:56.780173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:56.780722 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:56.785524 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "817b9afa-05b9-4968-9654-772f33dd05c7"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:56.787871 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:56.796226 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.796715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.797157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.797903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.798366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.798796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.888222 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: POST /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/os-volume_attachments HTTP/1.1 Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 74 Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:28:56.889831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {"volumeAttachment": {"volumeId": "817b9afa-05b9-4968-9654-772f33dd05c7"}} Aug 30 16:28:56.891448 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'server_id': 'dc69ca04-4867-4a3c-9f0b-cf2f13522101', 'body': {'volumeAttachment': {'volumeId': '817b9afa-05b9-4968-9654-772f33dd05c7'}}} Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:28:56.892579 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:56.893853 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 400 to user: Invalid volume: volume 817b9afa-05b9-4968-9654-772f33dd05c7 is already attached to instances: 986d0c22-4e47-46ab-a363-cc3371b6b4de {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0bd94b9b-a395-4eae-a856-d8439d36621d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113641 Aug 30 16:28:56.896361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 484/973] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:28:56 2022] POST /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:56.900189 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:56.900636 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:56.906550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.907035 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.907504 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.908200 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.908655 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.909077 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.936264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:28:57.013943 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1a1840b-bebc-4c82-9d3f-e1f5d6a63bfe tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 204 len: 0 microversion: 2.1 time: 0.117370 Aug 30 16:28:57.017496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 490/974] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:56 2022] DELETE /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:28:57.022788 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:57.023452 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:57.029369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.029855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.030291 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.030990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.031474 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.031899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.166950 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:57.175248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-19cfb3ff-873a-46c8-a8f8-a52f6e7c5f11 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1682 microversion: 2.1 time: 0.156282 Aug 30 16:28:57.175818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 485/975] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:57 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:58.198510 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:58.199240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:58.206453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:58.206879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:58.207367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:58.208076 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:58.208536 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:58.208965 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:58.357548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.366859 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55690df6-1302-40a4-8f95-731b23310017 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1682 microversion: 2.1 time: 0.172626 Aug 30 16:28:58.367667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 491/976] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:58 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:59.389794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:59.390437 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:59.397546 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.398024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.398471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.399180 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.399681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.400111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.495750 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:59.507116 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-729206c5-d635-4593-b0c1-771291d42c79 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 200 len: 1614 microversion: 2.1 time: 0.121557 Aug 30 16:28:59.508377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 486/977] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:59 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:59.709650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69ca04-4867-4a3c-9f0b-cf2f13522101", "name": "network-vif-deleted", "tag": "81fed6e5-5084-47d4-99d0-b484eb09c143"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:59.730228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.730947 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.732338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.751301 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] Creating event network-vif-deleted:81fed6e5-5084-47d4-99d0-b484eb09c143 for instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 on hv-cinder-85220 Aug 30 16:28:59.756765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1b7c247d-59d3-404a-bd80-0af2e9a906ae req-f28eea90-7735-45f5-8ac5-d3244ceb7ff5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253032 Aug 30 16:28:59.757369 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 492/978] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:00.531382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:00.531960 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:00.538542 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:00.539020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:00.539493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:00.540186 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:00.540637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:00.541055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:00.554886 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 HTTP/1.1 Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:29:00.556469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:29:00.558170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'dc69ca04-4867-4a3c-9f0b-cf2f13522101'} Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:00.559884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:29:00.561511 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:00.563201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:00.563201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-55893ffa-1690-456a-bd9d-77818c8a03ea tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 404 len: 111 microversion: 2.1 time: 0.030541 Aug 30 16:29:00.563201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 487/979] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:00 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:00.568385 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ec8496b-a2da-4ab5-8f07-03eead58a261 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '.version_select at 0x7f1266b1d940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:00.590402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ec8496b-a2da-4ab5-8f07-03eead58a261 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736392320" status: 202 len: 0 microversion: 2.1 time: 0.026480 Aug 30 16:29:00.594469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 493/980] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 30 16:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736392320 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:01.519128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:01.519647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:01.529156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.529640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.530099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:01.530805 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.531285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.531711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:01.615378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lazy-loading 'services' on Instance uuid 986d0c22-4e47-46ab-a363-cc3371b6b4de {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:01.691826 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-fb6a70ab-50ed-4820-8c74-3c1e431124cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments/817b9afa-05b9-4968-9654-772f33dd05c7" status: 202 len: 0 microversion: 2.1 time: 0.176464 Aug 30 16:29:01.692495 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 488/981] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:29:01 2022] DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments/817b9afa-05b9-4968-9654-772f33dd05c7 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:01.702006 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:01.704305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:01.711842 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.712354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.712874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:01.713631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.714176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.714613 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:01.747488 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-350c607b-2c03-4680-89e7-78f4c843727f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050249 Aug 30 16:29:01.748478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 494/982] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:29:01 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:02.761944 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:02.764402 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:02.771494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.771991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.772431 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.773138 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.773594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.774028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.807338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-26e41f29-f062-4152-8f16-c746e8b6df40 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050245 Aug 30 16:29:02.807938 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 489/983] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:29:02 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:03.819284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:03.821467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:03.827907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.828395 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.828830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.829515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.829966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.830386 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.861020 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e97cd1b7-abff-46a3-86d2-0974a2684e1f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Aug 30 16:29:03.861579 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 495/984] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:29:03 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:04.873771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:04.876086 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:04.882999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.883529 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.883972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.884685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.885144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.885576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.916069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b8f4f587-e2cd-46d3-8bf0-8c62e1d12d98 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046766 Aug 30 16:29:04.916648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 490/985] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:29:04 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:29:04.979908 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:04.980473 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:04.987091 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.987696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.988198 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.988959 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.989483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.989974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.016876 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:29:05.113750 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd255b92-c4b0-40a8-96c3-745c9be2cbad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 204 len: 0 microversion: 2.1 time: 0.137801 Aug 30 16:29:05.119292 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 496/986] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:29:04 2022] DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:29:05.123558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:05.124424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:05.131721 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.132790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.133434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.134340 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.135129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.141528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.283600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:05.291778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ad725e60-63ed-4387-98a1-bcb9fe36839d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1680 microversion: 2.1 time: 0.172886 Aug 30 16:29:05.292622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 491/987] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:05 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:06.314271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:06.314994 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:06.321295 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:06.321801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:06.322280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:06.322990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:06.323485 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:06.323914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:06.372144 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:29:06.372372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Tue Aug 30 16:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de (ip 10.222.0.57) !!! Aug 30 16:29:06.456215 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:06.463990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10829f4e-1322-4717-95a6-ae8b6e427ba4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1680 microversion: 2.1 time: 0.153982 Aug 30 16:29:06.464548 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 497/988] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:06 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:07.486914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:07.487717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:07.494587 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.495011 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.495505 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.496248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.496725 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.497361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.574470 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:07.583522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-83e66226-d1bf-4445-b682-90da0383df68 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 200 len: 1612 microversion: 2.1 time: 0.101294 Aug 30 16:29:07.584049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 492/989] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:07 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:07.740468 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986d0c22-4e47-46ab-a363-cc3371b6b4de", "name": "network-vif-deleted", "tag": "6e5fae51-833d-4af6-bc0a-2c3172988e35"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:07.755380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.756273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.756722 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.770611 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] Creating event network-vif-deleted:6e5fae51-833d-4af6-bc0a-2c3172988e35 for instance 986d0c22-4e47-46ab-a363-cc3371b6b4de on hv-cinder-85220 Aug 30 16:29:07.777816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8c8273a2-fb40-4007-8d80-1ecfc4142c36 req-ec53a60d-5a0f-4be9-bda7-7f85793d7311 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 Aug 30 16:29:07.783326 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 498/990] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:08.606668 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:08.608220 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:08.615706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.616237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.616690 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.617435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.618113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.618580 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.639854 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de HTTP/1.1 Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:29:08.641574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:29:08.643135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '986d0c22-4e47-46ab-a363-cc3371b6b4de'} Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:08.644080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:29:08.645560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:29:08.648567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:08.649449 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-272f2758-eb01-40cb-9443-44b9b69508d8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 404 len: 111 microversion: 2.1 time: 0.047906 Aug 30 16:29:08.650028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 493/991] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:08 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:08.660416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ec7bc11-d28b-4de3-a4a7-15585e4c4410 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '.version_select at 0x7f1266bd21f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:08.683647 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ec7bc11-d28b-4de3-a4a7-15585e4c4410 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761238323" status: 202 len: 0 microversion: 2.1 time: 0.028620 Aug 30 16:29:08.684363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 499/992] 10.222.0.57 () {58 vars in 1218 bytes} [Tue Aug 30 16:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761238323 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:09.350785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-af0c34db-1efe-44fd-8e22-3c6b0d028f90 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: .version_select at 0x7f1266dd6820>, body: {"keypair": {"name": "tempest-keypair-1934761675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkqXHbHC/epZyj3ViiQGdC9ZOkkUHcumCoIk7bt7xLqsyH7U45zZq1f6Jxr1cG6epwN9TeNS9fNWYPqIdbnRxcL/YFT74vOY65wCeXtOZhvA0LR6tGAgf0Ns6ZDAVefPw=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:09.367412 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-af0c34db-1efe-44fd-8e22-3c6b0d028f90 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:09.371197 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-af0c34db-1efe-44fd-8e22-3c6b0d028f90 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:09.393683 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-af0c34db-1efe-44fd-8e22-3c6b0d028f90 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047051 Aug 30 16:29:09.394477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 494/993] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:29:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:10.776910 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-207847351", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f01c0d68-8ce5-4320-b8be-3261ceb33308"}], "security_groups": [{"name": "tempest-securitygroup--1300112852"}], "key_name": "tempest-keypair-1934761675", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:10.886847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] validate_networks() for [('f01c0d68-8ce5-4320-b8be-3261ceb33308', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:11.282980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:11.283456 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:11.283933 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:11.284348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:11.284767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:11.293603 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.294093 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.294536 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.295305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.295885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.296206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.315698 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:11.319917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:11.331583 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:29:11.333975 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:29:11.385711 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9508e7e0-1989-42f0-91fe-a185c15c8ad3 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613546 Aug 30 16:29:11.386364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 500/994] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:29:11.398156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-12963e51-244a-4569-9223-ede494ff36ef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:11.399408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-12963e51-244a-4569-9223-ede494ff36ef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:11.481404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-12963e51-244a-4569-9223-ede494ff36ef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:11.493642 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-12963e51-244a-4569-9223-ede494ff36ef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1241 microversion: 2.1 time: 0.099730 Aug 30 16:29:11.507407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 495/995] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:11 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:12.515945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:12.516573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:12.534378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.535490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.535490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.536147 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.536674 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.537118 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.616771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:12.628794 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f318af4e-a83c-4bff-9a5a-df6a9f99f855 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1301 microversion: 2.1 time: 0.118141 Aug 30 16:29:12.630271 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 501/996] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:12 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1301 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:13.650872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:13.651490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:13.658251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.658752 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.659268 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.660284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.661530 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.661971 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.904427 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.912366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-200d96bf-bd1c-44fc-82b6-236ba4119c9e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.265325 Aug 30 16:29:13.913136 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 496/997] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:13 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:13.957416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a6e54c-7029-4d1e-9411-ffe12e19b57b", "tag": "d00223c4-e5c1-4e11-8e90-892c390bb0db"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:13.968319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.969040 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.969476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.981402 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] Creating event network-changed:d00223c4-e5c1-4e11-8e90-892c390bb0db for instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b on hv-cinder-85220 Aug 30 16:29:13.987266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-03533e8f-a05a-4635-b145-d042f8519294 req-bd754b91-376c-4ed5-85ba-72b7025c661b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 Aug 30 16:29:13.988095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 502/998] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:14.934787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:14.936020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:14.942160 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.942660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.943194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.943799 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.944388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.944817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.084436 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:15.092593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f765d284-56d2-4f31-9637-03facc1b7fda tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.161716 Aug 30 16:29:15.093664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 497/999] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:14 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:16.114744 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:16.115508 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:16.121668 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.122152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.123094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.123809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.124279 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.124709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.260963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:16.271004 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb18a60f-0bf9-4575-aec7-f0aa220c53b4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.160871 Aug 30 16:29:16.271681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 503/1000] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:16 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:17.291048 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:17.291880 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:17.298765 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.299370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.299857 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.300569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.301026 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.301450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.436518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:17.444994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b9feeda1-8628-428a-821a-3800d5cf9ab8 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.157885 Aug 30 16:29:17.445586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 498/1001] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:17 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:18.464993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:18.466389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:18.473785 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.474474 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.475282 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.476187 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.476808 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.477406 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.629925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.637886 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0b79f96-91bb-433d-bcaa-8ae0eea01fcd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.176723 Aug 30 16:29:18.639039 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 504/1002] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:18 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:19.658878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:19.659517 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:19.666165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.666644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.667073 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.667793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.668244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.668662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.901835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.910823 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e650fb51-9285-4240-9136-733cbbb055cc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.255645 Aug 30 16:29:19.911518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 499/1003] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:19 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:20.259367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a6e54c-7029-4d1e-9411-ffe12e19b57b", "name": "network-vif-plugged", "status": "completed", "tag": "d00223c4-e5c1-4e11-8e90-892c390bb0db"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:20.272323 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.272881 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.273316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.289021 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] Creating event network-vif-plugged:d00223c4-e5c1-4e11-8e90-892c390bb0db for instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b on hv-cinder-85220 Aug 30 16:29:20.294879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e2469817-66a2-44f6-8305-c4bb8322503a req-4b7a651e-a126-4f4e-9bac-a2d0f7435034 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199768 Aug 30 16:29:20.295846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 505/1004] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:20.932869 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:20.933576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:20.949977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.951775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.952987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.954195 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.955434 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.957219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.096899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.104882 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-14c32ee0-093f-46be-afad-53507aa33631 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1367 microversion: 2.1 time: 0.175809 Aug 30 16:29:21.105462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 500/1005] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:20 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:22.125034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:22.126590 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:22.134064 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.135115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.143941 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.144861 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.145525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.146739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.151106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.152602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.374270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.386262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a45cdee8-0230-45b8-8931-ff68f5679375 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1557 microversion: 2.1 time: 0.263555 Aug 30 16:29:22.386982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 506/1006] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:22.408888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.410122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.414509 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:22.424380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.425088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.425667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.426554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.427616 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.428539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.528110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-47ceb7d0-976b-48cc-8d35-4a7438bcd1de tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124555 Aug 30 16:29:22.528716 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 501/1007] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:23.668659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a6e54c-7029-4d1e-9411-ffe12e19b57b", "tag": "d00223c4-e5c1-4e11-8e90-892c390bb0db"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:23.680262 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.683797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.684378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.699178 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] Creating event network-changed:d00223c4-e5c1-4e11-8e90-892c390bb0db for instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b on hv-cinder-85220 Aug 30 16:29:23.705436 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-43952928-e71b-40f0-86bb-9270f6feaa6e req-df1b7a70-65f0-41b0-8764-de086d4ec2ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041473 Aug 30 16:29:23.706389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 507/1008] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:29.102206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:29:29.102740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Tue Aug 30 16:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.57) !!! Aug 30 16:29:29.284974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-48e027d7-33e2-41aa-a37a-225abef36379 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Action: 'create', calling method: .version_select at 0x7f1266c95670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2114089154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQJYVmYybqmPBAgAY5I6yXqKMRUmn0IdDBgGLcU1Rn/0/G+XY1YpPm7eOyKNng1iq4NQmF2qIs+XOWXiGrBfvhv/XQDfu2chAO1b08bIFBrWo9caSYFu0bp7t/QIEzsng=="}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:29.290175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:29.301792 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-48e027d7-33e2-41aa-a37a-225abef36379 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for project 63e7ee5c71674c23aca48909b417a52a. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:29.305389 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-48e027d7-33e2-41aa-a37a-225abef36379 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for user 20cf8769967d4169be2a2a82431c7df6 and project 63e7ee5c71674c23aca48909b417a52a. Resources: {'key_pairs'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:29.326633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-48e027d7-33e2-41aa-a37a-225abef36379 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.225641 Aug 30 16:29:29.327300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 502/1009] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:29:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:53.011515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:53.012269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:53.017264 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1039105964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2114089154", "security_groups": [{"name": "tempest-secgroup-smoke-1918406516"}], "block_device_mapping_v2": [{"uuid": "9c1a6f9b-aebd-44ef-97bf-9c2a24e0a67c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc47b31-d639-4374-adee-5bb947993931"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:53.137220 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] validate_networks() for [('1fc47b31-d639-4374-adee-5bb947993931', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:53.508475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:53.508905 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:53.509381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:53.509797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:53.510237 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:53.518988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:53.519497 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:53.519931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.520661 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:53.521121 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:53.521553 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.538030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:53.542070 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for user 20cf8769967d4169be2a2a82431c7df6 and project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:53.600626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:29:53.602860 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c1a6f9b-aebd-44ef-97bf-9c2a24e0a67c',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:29:53.741267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b422a85-1334-46f2-9c32-e8d44f9b0a91 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731261 Aug 30 16:29:53.741922 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 508/1010] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:29:53.750586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:53.751501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=4 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:53.752030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:53.756228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-900f701d-ede8-42cd-b432-fba427c9e3fc tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:53.756782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-900f701d-ede8-42cd-b432-fba427c9e3fc tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:53.813910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-900f701d-ede8-42cd-b432-fba427c9e3fc tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:53.821204 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-900f701d-ede8-42cd-b432-fba427c9e3fc tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1095 microversion: 2.1 time: 0.072434 Aug 30 16:29:53.821797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 503/1011] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:53 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:54.842609 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:54.843273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:54.849837 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.850336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.851027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.852058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.852686 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.853276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.922793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:54.931692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a444375-438a-4f77-969d-e663744359bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1211 microversion: 2.1 time: 0.093707 Aug 30 16:29:54.932287 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 509/1012] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:54 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:55.954056 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:55.954659 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:55.961146 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:55.961576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:55.962019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:55.962728 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:55.963191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:55.963648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:56.152009 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:56.159650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a730f83c-6fcd-4f6a-81c1-953185948051 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.209924 Aug 30 16:29:56.160238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 504/1013] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:55 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:56.192389 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da074dd8-200d-4a07-b279-eb1fd9082281", "tag": "2589882c-dc44-4c10-99f1-0fc9dc5279a7"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:56.203562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:56.204137 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:56.204638 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:56.216689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] Creating event network-changed:2589882c-dc44-4c10-99f1-0fc9dc5279a7 for instance da074dd8-200d-4a07-b279-eb1fd9082281 on hv-cinder-85220 Aug 30 16:29:56.221564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a68d5084-cd40-4cfe-9d2f-7363ee76eef2 req-d1f378c1-f90d-4165-ae3d-8a1821e30f40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Aug 30 16:29:56.222276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 510/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:29:57.182599 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.183215 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.189798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.190283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.190724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.191462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.191924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.192359 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.322820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:57.331023 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-11231cc6-107b-4bd4-98c9-32a8db12fa28 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.152319 Aug 30 16:29:57.331789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 505/1015] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:57 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:58.352659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:58.353359 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:58.360176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:58.360666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:58.361108 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:58.361809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:58.362276 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:58.362708 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:58.495885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:58.503663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fcbf982-5158-463e-ae02-d58a7d12b767 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.155699 Aug 30 16:29:58.504240 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 511/1016] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:58 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:59.525603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:59.526368 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:59.533194 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:59.533685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:59.534126 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:59.534876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:59.535369 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:59.535800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:59.665983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:59.674238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2c61f6c4-f127-477f-962d-c80e1f064e5d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.153521 Aug 30 16:29:59.674813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 506/1017] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:59 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:00.696376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:00.696999 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:00.704130 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.704635 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.705069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.705773 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.706236 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.706671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.838943 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:00.846662 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57ea5c4e-1e8c-4a20-b0cb-01947d72041a tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.154187 Aug 30 16:30:00.847238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 512/1018] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:00 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:01.871630 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:01.872238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:01.878769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.879294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.880000 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.880706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.881168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.881601 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:02.013998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:02.022324 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d379a717-a7b4-4e0c-9ad4-3b76b92526d4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.154625 Aug 30 16:30:02.022903 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 507/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:01 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:03.043642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:03.044268 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:03.051704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.052372 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.052882 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.053641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.054104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.054540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.188449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:03.196196 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5efa8753-4cb4-492c-959f-9257910e99a3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.156512 Aug 30 16:30:03.196768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 513/1020] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:03 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:04.217362 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.218083 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.220515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:04.226244 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.226747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.227199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.228002 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.228471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.228901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.360171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:04.368001 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-be2025c9-2e5b-41f0-87c6-841124368275 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.154601 Aug 30 16:30:04.368685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 508/1021] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:05.390561 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:05.391685 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:05.393766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:05.394467 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:05.400967 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.401806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.402380 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.403020 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.403509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.404491 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.552391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:05.560508 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5f97cf3-3bd2-43d0-84cd-4a3a504a5214 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.174932 Aug 30 16:30:05.561563 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 514/1022] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:05 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:06.582203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:06.582810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:06.589253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.589734 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.590165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.590855 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.591335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.591758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.976239 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:06.984431 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-63118e94-9dea-4042-8612-35a8cf6781b9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.406126 Aug 30 16:30:06.985010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 509/1023] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:06 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:08.006026 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:08.006641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:08.013155 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.013643 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.014089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.014783 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.015266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.015707 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.145404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:08.153560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63554616-734d-41f6-81e4-2c3b4ea92ff9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.151768 Aug 30 16:30:08.154179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 515/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:08 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:08.313497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da074dd8-200d-4a07-b279-eb1fd9082281", "name": "network-vif-plugged", "status": "completed", "tag": "2589882c-dc44-4c10-99f1-0fc9dc5279a7"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:08.324664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.325156 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.325593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.337311 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] Creating event network-vif-plugged:2589882c-dc44-4c10-99f1-0fc9dc5279a7 for instance da074dd8-200d-4a07-b279-eb1fd9082281 on hv-cinder-85220 Aug 30 16:30:08.342998 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-a484129c-ebd1-4b6f-9935-0a824d2e0c1e req-0d1dd4c7-0d93-480b-9e65-138c741a6da2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Aug 30 16:30:08.343982 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 510/1025] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:09.174890 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.175525 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:09.182052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.182541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.182985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.183709 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.184174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.184603 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.317472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:09.325352 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1dc461a-fe71-4712-a1e0-10ebc542e7b4 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1267 microversion: 2.1 time: 0.154928 Aug 30 16:30:09.325930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 516/1026] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:10.346973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:10.347692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:10.358676 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.359183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.360432 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.361309 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.362151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.362923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.503819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:10.511964 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7354bd3d-99da-4da2-ab2c-2484a098e8c0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1454 microversion: 2.1 time: 0.169689 Aug 30 16:30:10.512558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 511/1027] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:10 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:10.532872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:10.533703 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:10.539877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.540369 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.540809 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.541519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.541980 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.542414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.677025 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:10.685073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89654833-e559-4c47-9895-ce4ec59e07a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1454 microversion: 2.1 time: 0.157097 Aug 30 16:30:10.685672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 517/1028] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:10 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:12.491705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da074dd8-200d-4a07-b279-eb1fd9082281", "tag": "2589882c-dc44-4c10-99f1-0fc9dc5279a7"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:12.503032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.503933 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.504379 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.516108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] Creating event network-changed:2589882c-dc44-4c10-99f1-0fc9dc5279a7 for instance da074dd8-200d-4a07-b279-eb1fd9082281 on hv-cinder-85220 Aug 30 16:30:12.521226 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-7071d54a-9bad-42ec-9515-3214bf5ea2f1 req-3407dc3b-9520-4eb2-ad61-054f4103cbee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090442 Aug 30 16:30:12.521770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 512/1029] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:40.014246 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:40.014986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=52 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:40.114424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:40.114927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:40.121033 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.121518 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.121957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.122651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.123105 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.123570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.147057 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9d0af4e-5b4a-489c-a8e5-b367edeba421 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/ips" status: 200 len: 149 microversion: 2.1 time: 0.137638 Aug 30 16:30:40.147672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 518/1030] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:30:40 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/ips => generated 149 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:41.489905 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=22 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:41.490652 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=46 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:41.496085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2657ab6-b56f-4da1-8b3c-96817efbc317"}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:41.498487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:41.506257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.506753 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.507196 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.507924 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.508388 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.508822 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.752198 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3f777713-ed81-4d6a-968d-a54f729dca8c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263600 Aug 30 16:30:41.752813 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 513/1031] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:30:41 2022] POST /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:49.275079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2657ab6-b56f-4da1-8b3c-96817efbc317"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:49.277530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:49.284109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.284535 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.284978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.285680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.286141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.286579 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.364161 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments HTTP/1.1 Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 74 Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:30:49.365900 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "c2657ab6-b56f-4da1-8b3c-96817efbc317"}} Aug 30 16:30:49.367660 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'server_id': 'b7a6e54c-7029-4d1e-9411-ffe12e19b57b', 'body': {'volumeAttachment': {'volumeId': 'c2657ab6-b56f-4da1-8b3c-96817efbc317'}}} Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:49.368629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:49.370122 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 400 to user: Invalid volume: volume c2657ab6-b56f-4da1-8b3c-96817efbc317 is already attached to instances: b7a6e54c-7029-4d1e-9411-ffe12e19b57b {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96566975-9c4c-49e9-8fdc-32c2074a370d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096252 Aug 30 16:30:49.371788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 519/1032] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:30:49 2022] POST /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:30:49.435919 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:49.436613 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:49.443187 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.443773 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.444212 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.444915 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.445371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.445797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.524976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lazy-loading 'services' on Instance uuid b7a6e54c-7029-4d1e-9411-ffe12e19b57b {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:49.598545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8084f781-5549-4439-b12d-6f10b21fc3a0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments/c2657ab6-b56f-4da1-8b3c-96817efbc317" status: 202 len: 0 microversion: 2.1 time: 0.167011 Aug 30 16:30:49.599127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 514/1033] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:30:49 2022] DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments/c2657ab6-b56f-4da1-8b3c-96817efbc317 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:30:49.608030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:49.610878 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:49.618028 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.618614 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.619500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.620217 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.620828 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.621403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.658272 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d877837-0068-4ce0-9655-249e7d48c99e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054736 Aug 30 16:30:49.658847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 520/1034] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:49 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:50.671201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:50.673950 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:50.680201 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.680685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.681132 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.681827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.682289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.682717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.717081 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4790e28d-d93e-465f-ae68-dd2be7af6131 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050645 Aug 30 16:30:50.717661 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 515/1035] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:50 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:30:50.779532 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:50.780089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:50.787048 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.787588 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.788032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.788738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.789197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.789631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.815375 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:50.895641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ea13bdf-8614-4d91-a005-db8f912b1a30 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 204 len: 0 microversion: 2.1 time: 0.119553 Aug 30 16:30:50.896642 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 521/1036] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:50 2022] DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:50.904883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:50.905502 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:50.911973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.912458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.912899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.913593 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.914051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.914476 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:51.049144 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.057783 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-29367457-aa71-4bb8-9953-139e948a1ef4 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1681 microversion: 2.1 time: 0.156794 Aug 30 16:30:51.058366 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 516/1037] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:50 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:52.080476 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:52.081183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:52.087684 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.088192 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.088631 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:52.089336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.089803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.090230 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:52.227757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:52.235496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56caa038-0cad-402a-b38b-0bf780dd861c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1681 microversion: 2.1 time: 0.159239 Aug 30 16:30:52.236706 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 522/1038] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:52 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:53.258080 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:53.258789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:53.265064 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.265554 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.265993 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.266699 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.267157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.267626 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.459707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:53.467549 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-08c9da7a-b58c-4b7f-b768-89dc9bdbb1bc tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1681 microversion: 2.1 time: 0.214236 Aug 30 16:30:53.468357 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 517/1039] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:53 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:53.761364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a6e54c-7029-4d1e-9411-ffe12e19b57b", "name": "network-vif-deleted", "tag": "d00223c4-e5c1-4e11-8e90-892c390bb0db"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:53.774848 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.775500 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.776223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.792245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] Creating event network-vif-deleted:d00223c4-e5c1-4e11-8e90-892c390bb0db for instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b on hv-cinder-85220 Aug 30 16:30:53.797958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-600fce34-e6cc-457b-b030-8c43bd8ae3b7 req-ad1876d4-e7e3-4580-b812-53894031d77c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041366 Aug 30 16:30:53.798872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 523/1040] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:54.490127 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:54.490973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:54.498282 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.499084 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.499637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.500445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.500909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.501358 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.536965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.537465 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.537912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.538501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lazy-loading 'fault' on Instance uuid b7a6e54c-7029-4d1e-9411-ffe12e19b57b {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:54.585276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.592985 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-dc93febe-cf49-4cae-8eaa-f75d65155e25 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 200 len: 1331 microversion: 2.1 time: 0.107718 Aug 30 16:30:54.593586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 518/1041] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:54 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:55.616366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:55.617082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:55.623845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:55.624339 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:55.624782 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:55.625494 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:55.625978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:55.626391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:55.640718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b HTTP/1.1 Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:30:55.642381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:30:55.644103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'b7a6e54c-7029-4d1e-9411-ffe12e19b57b'} Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:55.645208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:30:55.646658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:30:55.648032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:55.648032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7997631d-8db1-4f0f-a812-e4bc74dd3339 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 404 len: 111 microversion: 2.1 time: 0.032328 Aug 30 16:30:55.648032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 524/1042] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:55 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:55.652820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-3f33a101-7a9d-4ea0-a74c-c67526ed23af tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '.version_select at 0x7f1267058ee0>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:55.671640 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-3f33a101-7a9d-4ea0-a74c-c67526ed23af tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934761675" status: 202 len: 0 microversion: 2.1 time: 0.022581 Aug 30 16:30:55.672203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 519/1043] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 30 16:30:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934761675 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:30:56.294663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d306ab3d-a3ef-4f0e-bd17-30adac7a99f6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: .version_select at 0x7f1266b939d0>, body: {"keypair": {"name": "tempest-keypair-1392954813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTulm6Lns6iODSGIEGZzAaVm33OfB/GmAJregTJtDD3QUnlpUwUdB1nSy7D6UZlmC/UmGGn4iWXz/8jZyD0lV7zQL/V0GHLvKp5l81DIIjjVWqBGKwrlAXPieiK5Sdv4w=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:56.310712 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-d306ab3d-a3ef-4f0e-bd17-30adac7a99f6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:56.314637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-d306ab3d-a3ef-4f0e-bd17-30adac7a99f6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:56.338891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d306ab3d-a3ef-4f0e-bd17-30adac7a99f6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047750 Aug 30 16:30:56.339924 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 525/1044] 10.222.0.57 () {60 vars in 1159 bytes} [Tue Aug 30 16:30:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:57.566967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-187311025", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f01c0d68-8ce5-4320-b8be-3261ceb33308"}], "security_groups": [{"name": "tempest-securitygroup--854325805"}], "key_name": "tempest-keypair-1392954813", "user_data": "}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:57.671171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] validate_networks() for [('f01c0d68-8ce5-4320-b8be-3261ceb33308', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:30:58.095775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:58.096802 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:58.097279 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:58.097694 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:58.098117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:58.107284 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.107777 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.108218 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.108994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.109453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.109885 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.126492 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:58.130954 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Getting quotas for user ea15538623ef4bacb42c4e03e2db72c5 and project d08b7bad519b4188b8cef19735f023fe. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:58.141731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:30:58.144898 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:58.200790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bb447330-97b5-421d-8f58-a3f2f2f4298f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638441 Aug 30 16:30:58.201663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 520/1045] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:30:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:30:58.212332 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3c7997d-295c-44ef-b326-f0705d74997b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:58.213056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3c7997d-295c-44ef-b326-f0705d74997b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:58.277802 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3c7997d-295c-44ef-b326-f0705d74997b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:58.286447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3c7997d-295c-44ef-b326-f0705d74997b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1241 microversion: 2.1 time: 0.077950 Aug 30 16:30:58.287034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 526/1046] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:58 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:59.306794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:59.307431 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:59.314182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.314711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.315153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.316210 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.316672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.317424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.382192 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:59.389807 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-73a8a810-065c-4709-aeb7-90bc20deb877 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1299 microversion: 2.1 time: 0.087093 Aug 30 16:30:59.390382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 521/1047] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:59 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:00.411357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:00.411986 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:00.418478 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.418974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.419533 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.420248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.420741 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.421179 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.527294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27060f79-0229-4bc1-8fda-35492639b40e", "tag": "ffd64e72-df99-463c-a50d-9883b5c2f16b"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:00.541295 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.542171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.542835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.555335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] Creating event network-changed:ffd64e72-df99-463c-a50d-9883b5c2f16b for instance 27060f79-0229-4bc1-8fda-35492639b40e on hv-cinder-85220 Aug 30 16:31:00.561167 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-46c7445f-dd22-48c2-9c6f-048924a16ff1 req-88c24c3b-1888-4cf4-89ee-3e8a0c8a9b9f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Aug 30 16:31:00.562042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 522/1048] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:31:00.830926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:00.838909 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6109ab14-828f-4335-8dc5-428bed430ff0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.431571 Aug 30 16:31:00.839523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 527/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:00 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:01.861852 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:01.862558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:01.868723 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.869203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.869644 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.870335 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.870794 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.871246 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.008172 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:02.015760 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1f3b4623-aa41-4222-8bf3-e4aa3a075ab6 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.158654 Aug 30 16:31:02.016338 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 523/1050] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:01 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:03.037043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:03.037672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:03.044231 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.044725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.045169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.045962 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.046432 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.046865 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.178316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:03.186300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6a67713-d93e-42af-9033-fbf467b18137 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.153842 Aug 30 16:31:03.186901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 528/1051] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:03 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:04.207069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:04.207736 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:04.214185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:04.214667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:04.215112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:04.215832 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:04.216290 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:04.216717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:04.346361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:04.354019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-071de3d7-d93f-4c7c-977b-afd1a8bbac3c tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.150798 Aug 30 16:31:04.354788 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 524/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:04 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:05.374023 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:05.374566 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:05.381550 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:05.382034 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:05.382472 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:05.383174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:05.383657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:05.384088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:05.521164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:05.528846 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6962225e-2bf7-4a27-9d08-151b348b75f9 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.158808 Aug 30 16:31:05.529410 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 529/1053] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:05 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:06.550024 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:06.550634 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:06.557240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.557763 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.558193 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.558887 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.559380 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.559798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.693692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:06.701658 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-9f97aee7-4c70-4864-83b8-e4a610d55d1b tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.155538 Aug 30 16:31:06.702255 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 525/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:06 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:06.713597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27060f79-0229-4bc1-8fda-35492639b40e", "name": "network-vif-plugged", "status": "completed", "tag": "ffd64e72-df99-463c-a50d-9883b5c2f16b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:06.724978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.725463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.725907 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.739653 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] Creating event network-vif-plugged:ffd64e72-df99-463c-a50d-9883b5c2f16b for instance 27060f79-0229-4bc1-8fda-35492639b40e on hv-cinder-85220 Aug 30 16:31:06.744895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d5196d92-c055-4c9f-83ec-0b4febfea1ce req-38b2b9f8-049c-4265-bede-1e951ef17088 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034959 Aug 30 16:31:06.745495 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 530/1055] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:07.723164 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:07.723810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:07.730227 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.730713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.731155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.731879 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.732342 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.732769 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.863787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:07.871457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-72db435c-3559-4f87-ab9c-de23d06869cd tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1366 microversion: 2.1 time: 0.152724 Aug 30 16:31:07.872032 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 526/1056] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:07 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:08.891368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:08.896370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:08.897015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:08.903734 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.904222 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.904666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:08.905367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.905836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.906265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.036202 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:09.044126 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e8184e5-0377-4cbc-9da5-ce356b86f005 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1556 microversion: 2.1 time: 0.154143 Aug 30 16:31:09.044730 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 531/1057] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:08 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:09.064846 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:09.065396 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:09.067250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:09.068030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:09.074183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.074664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.075099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.075814 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.076270 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.076717 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.154044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b0f1b1f0-3d7a-4d26-9f49-7f0deef259fa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093071 Aug 30 16:31:09.154650 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 527/1058] 10.222.0.57 () {58 vars in 1275 bytes} [Tue Aug 30 16:31:09 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:10.083186 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27060f79-0229-4bc1-8fda-35492639b40e", "tag": "ffd64e72-df99-463c-a50d-9883b5c2f16b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:10.088618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:10.094699 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:10.095183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:10.095735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:10.099306 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:10.111496 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] Creating event network-changed:ffd64e72-df99-463c-a50d-9883b5c2f16b for instance 27060f79-0229-4bc1-8fda-35492639b40e on hv-cinder-85220 Aug 30 16:31:10.116654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7655e312-e81e-4185-b469-e1a0b74a6c4d req-ff864711-7afd-490f-ad07-18c51d7d00d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037653 Aug 30 16:31:10.117490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 532/1059] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:14.846093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:14.846965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:14.852353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:14.852845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:14.861424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:14.861904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:14.862336 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:14.863028 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:14.863503 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:14.863984 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:14.889820 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-57658e0e-7cf9-4d6d-afd8-c010a02173f0 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/ips" status: 200 len: 150 microversion: 2.1 time: 0.045519 Aug 30 16:32:14.890377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 528/1060] 10.222.0.57 () {58 vars in 1248 bytes} [Tue Aug 30 16:32:14 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:16.215627 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:16.220988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9c9090-0ddc-4e14-af76-80ae5c39d49b"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:16.223440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:16.230367 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:16.230855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:16.231320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.232022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:16.232481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:16.232912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.571806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19060e4c-4295-416a-9dc7-cc8372663faa tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "POST /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358433 Aug 30 16:32:16.572758 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 533/1061] 10.222.0.57 () {60 vars in 1323 bytes} [Tue Aug 30 16:32:16 2022] POST /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:24.187947 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:24.188471 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:24.195372 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.195856 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.196294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.196996 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.197455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.197883 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.329970 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.objects.instance [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lazy-loading 'services' on Instance uuid 27060f79-0229-4bc1-8fda-35492639b40e {{(pid=120589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:32:24.402573 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f6506c71-196f-4c2a-868b-a3ed083ad584 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments/0e9c9090-0ddc-4e14-af76-80ae5c39d49b" status: 202 len: 0 microversion: 2.1 time: 0.218439 Aug 30 16:32:24.403164 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 529/1062] 10.222.0.57 () {58 vars in 1416 bytes} [Tue Aug 30 16:32:24 2022] DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments/0e9c9090-0ddc-4e14-af76-80ae5c39d49b => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:32:24.414243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:24.416864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:24.424230 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.425278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.425729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.426449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.427089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.427554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.460024 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30877850-93eb-4c2d-8346-1e0ac126223a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052279 Aug 30 16:32:24.460587 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 534/1063] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:32:24 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:25.473600 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.476673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.482850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.483370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.483810 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.484537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.484995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.485419 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.514701 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ed09a73b-0444-4f05-80cb-522a6139d801 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046040 Aug 30 16:32:25.515283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 530/1064] 10.222.0.57 () {58 vars in 1302 bytes} [Tue Aug 30 16:32:25 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:32:25.576234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.576775 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.583753 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.584288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.584729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.585420 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.585874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.586299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.612605 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:32:25.687169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17a4ee91-f7cd-4a9d-b9b3-584f4898df34 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 204 len: 0 microversion: 2.1 time: 0.114538 Aug 30 16:32:25.688098 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 535/1065] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:25 2022] DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:32:25.697044 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.697921 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.704029 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.704518 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.704956 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.705655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.706115 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.706543 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.841983 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.850135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-710c380f-9f05-4e99-82eb-7d0a31c6caaf tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1681 microversion: 2.1 time: 0.157860 Aug 30 16:32:25.850714 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 531/1066] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:25 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:26.872267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:26.872978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:26.880112 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.880602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.881060 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:26.881770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.882233 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.882667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.023447 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.031117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ecc3d6c5-c451-42ce-953e-45ae3a713d00 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1681 microversion: 2.1 time: 0.163196 Aug 30 16:32:27.031720 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 536/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:26 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:28.052559 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:28.053316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:28.059968 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.060463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.060909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.061811 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.062528 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.062967 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.337706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea15538623ef4bacb42c4e03e2db72c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b7bad519b4188b8cef19735f023fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.346141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-081ee48c-4933-430a-a1ca-f27b6af94bb1 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 200 len: 1681 microversion: 2.1 time: 0.297983 Aug 30 16:32:28.346728 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 532/1068] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:28 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:28.831509 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27060f79-0229-4bc1-8fda-35492639b40e", "name": "network-vif-deleted", "tag": "ffd64e72-df99-463c-a50d-9883b5c2f16b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:28.846094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.847312 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.848459 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.864771 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] Creating event network-vif-deleted:ffd64e72-df99-463c-a50d-9883b5c2f16b for instance 27060f79-0229-4bc1-8fda-35492639b40e on hv-cinder-85220 Aug 30 16:32:28.869912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-80a1448b-2e99-4b31-af6d-8b52f6731c3c req-8c9c13ed-7217-43b8-967a-011eb4906e1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Aug 30 16:32:28.870514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 537/1069] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:29.368908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.369468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.376872 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.377407 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.378030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.378847 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.379605 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.380071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.393922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e HTTP/1.1 Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:32:29.395675 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:29.397356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '27060f79-0229-4bc1-8fda-35492639b40e'} Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:29.398258 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:29.399798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:29.401025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:29.401025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-369cdd9b-e22e-4b64-99a1-e1f920b98629 tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 404 len: 111 microversion: 2.1 time: 0.032645 Aug 30 16:32:29.401025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 533/1070] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:29 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:32:29.403858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:32:29.404348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Tue Aug 30 16:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1392954813 (ip 10.222.0.57) !!! Aug 30 16:32:29.408869 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3280144c-3559-465f-92b0-fd1a0540b22a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '.version_select at 0x7f1266d59f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.435022 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3280144c-3559-465f-92b0-fd1a0540b22a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392954813" status: 202 len: 0 microversion: 2.1 time: 0.032090 Aug 30 16:32:29.435749 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 538/1071] 10.222.0.57 () {58 vars in 1221 bytes} [Tue Aug 30 16:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392954813 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:32:29.513746 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.514271 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.521170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.521665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.522317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.523189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.523842 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.524277 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.554321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:32:29.667357 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2400ce8b-0683-4779-b228-50d61280d66e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "DELETE /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 204 len: 0 microversion: 2.1 time: 0.156966 Aug 30 16:32:29.668537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 534/1072] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:29 2022] DELETE /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:32:29.676825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.677735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.685523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.686365 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.687032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.688019 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.688687 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.689119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.930629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:29.940047 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8df83437-7e2d-48cd-a6ba-d9621bcd8d97 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1579 microversion: 2.1 time: 0.267272 Aug 30 16:32:29.940626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 539/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:29 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1579 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:30.962951 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:30.963715 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:30.970151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:30.970664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:30.971123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:30.972030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:30.972487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:30.972910 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.104088 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.111798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4387c48d-c69e-4140-bdce-3ab26129f20b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1579 microversion: 2.1 time: 0.153239 Aug 30 16:32:31.112370 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 535/1074] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:30 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:31.315463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:31.315974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:31.322378 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.322923 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.323339 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.324044 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.324502 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.324990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.339866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e HTTP/1.1 Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:31.341679 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.345043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '27060f79-0229-4bc1-8fda-35492639b40e'} Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:31.346678 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.348305 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.350398 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:31.350398 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b39595dd-2f73-418d-9c90-3c1bf9ff8d4f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 30 16:32:31.350398 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 540/1075] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:31 2022] DELETE /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:31.354223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:31.354923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 27060f79-0229-4bc1-8fda-35492639b40e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:31.361100 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.361673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.362507 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.363096 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.363721 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.364269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.377922 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e HTTP/1.1 Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:32:31.379914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.381589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '27060f79-0229-4bc1-8fda-35492639b40e'} Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:31.382516 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. Aug 30 16:32:31.384031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:31.385534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 27060f79-0229-4bc1-8fda-35492639b40e could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:31.385534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b4bf906d-3624-4794-94fb-1609726b5a2e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e" status: 404 len: 111 microversion: 2.1 time: 0.032466 Aug 30 16:32:31.385534 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 536/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:31 2022] GET /compute/v2.1/servers/27060f79-0229-4bc1-8fda-35492639b40e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:32.086888 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da074dd8-200d-4a07-b279-eb1fd9082281", "name": "network-vif-deleted", "tag": "2589882c-dc44-4c10-99f1-0fc9dc5279a7"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:32.096244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.096731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.097172 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.109371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] Creating event network-vif-deleted:2589882c-dc44-4c10-99f1-0fc9dc5279a7 for instance da074dd8-200d-4a07-b279-eb1fd9082281 on hv-cinder-85220 Aug 30 16:32:32.114320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-20000a53-708d-4b17-b89d-3d6f86559c17 req-9fb725b7-b3f7-4e3a-a227-53d94e3b581b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Aug 30 16:32:32.114974 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 541/1077] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:32.143321 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.144739 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.154865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.155731 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.156406 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.157213 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.157748 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.158343 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.232294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:32.241116 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a999d1b9-bfaa-4cda-93d4-f5a2a2062650 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 200 len: 1226 microversion: 2.1 time: 0.111943 Aug 30 16:32:32.242322 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 537/1078] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:32.534253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.534858 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.541328 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.541828 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.542274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.542988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.543541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.543979 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.557684 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b HTTP/1.1 Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:32.559514 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.561015 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'b7a6e54c-7029-4d1e-9411-ffe12e19b57b'} Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:32.564806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.566368 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.568435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:32.568435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-504f6c72-55de-4437-adac-79cd102a096d tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 404 len: 111 microversion: 2.1 time: 0.031437 Aug 30 16:32:32.568435 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 542/1079] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:32 2022] DELETE /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:32:32.569908 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.570525 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: b7a6e54c-7029-4d1e-9411-ffe12e19b57b] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.576478 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.576969 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.577408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.578110 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.578570 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.579003 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.596142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b HTTP/1.1 Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:32:32.597688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.599526 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'b7a6e54c-7029-4d1e-9411-ffe12e19b57b'} Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:32.603188 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. Aug 30 16:32:32.604737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.606099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance b7a6e54c-7029-4d1e-9411-ffe12e19b57b could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:32.606099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-72ffd218-4619-4482-b25d-5d5ff6856d8a tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b" status: 404 len: 111 microversion: 2.1 time: 0.033534 Aug 30 16:32:32.606099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 538/1080] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/b7a6e54c-7029-4d1e-9411-ffe12e19b57b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:32.608289 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.608799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.615453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.616147 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.616594 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.617300 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.617759 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.618191 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.633193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 HTTP/1.1 Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:32.634763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.636418 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'dc69ca04-4867-4a3c-9f0b-cf2f13522101'} Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:32.637331 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.638871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.640650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:32.640650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9782dbb3-85f0-4b0c-8735-0b33250aa23e tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 404 len: 111 microversion: 2.1 time: 0.031956 Aug 30 16:32:32.640650 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 543/1081] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:32 2022] DELETE /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:32.644619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.645245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: dc69ca04-4867-4a3c-9f0b-cf2f13522101] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.651751 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.652253 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.652696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.653408 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.653870 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.654300 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.668959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 HTTP/1.1 Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:32:32.670506 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.672019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'dc69ca04-4867-4a3c-9f0b-cf2f13522101'} Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:32.672858 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. Aug 30 16:32:32.674181 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:32:32.675386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance dc69ca04-4867-4a3c-9f0b-cf2f13522101 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:32.675386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ffcd623d-4bd7-4c7b-a7d0-e758baa654ad tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101" status: 404 len: 111 microversion: 2.1 time: 0.031174 Aug 30 16:32:32.675386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 539/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/dc69ca04-4867-4a3c-9f0b-cf2f13522101 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:32:33.261948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:33.262558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:33.268792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.269269 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.269702 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.270445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.270901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.271355 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.284787 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] HTTP exception thrown: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Request method failure captured: Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 HTTP/1.1 Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjrjcPIajaM9CnH4cNitYbPis4JBhxv4k0iwTMGjysvs3g2LEaLVdwNFYMGFtUys7mn6sBV4TS_PJTNn4dF9pvAahvbS9kv1fZF7IAgXItNm4R5PhyHBiIlhmXExBeFdGeURnGB6l6cLdK878BTrWEwJsjXO3LZJOEkCNO1SuCThqSo Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:33.286857 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}] Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 20cf8769967d4169be2a2a82431c7df6 Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:32:33.288560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'da074dd8-200d-4a07-b279-eb1fd9082281'} Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:33.289564 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:32:33.291103 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.292507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Returning 404 to user: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:33.292507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f4aa964-f9e1-454b-9855-edeb3b748448 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 404 len: 111 microversion: 2.1 time: 0.030273 Aug 30 16:32:33.292507 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 544/1083] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:33 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:33.336272 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-36067344", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2114089154", "security_groups": [{"name": "tempest-secgroup-smoke-1918406516"}], "block_device_mapping_v2": [{"uuid": "9c1a6f9b-aebd-44ef-97bf-9c2a24e0a67c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc47b31-d639-4374-adee-5bb947993931"}]}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:33.451547 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] validate_networks() for [('1fc47b31-d639-4374-adee-5bb947993931', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:32:33.821114 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:32:33.821632 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:32:33.822219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:32:33.822698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:32:33.823182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:32:33.832942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:33.834119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:33.836469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.836961 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.837397 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.838334 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.838975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.839438 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.840861 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.841414 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.841926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.842691 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.843207 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.843723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.856685 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:32:33.858063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de HTTP/1.1 Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:33.859723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.861463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '986d0c22-4e47-46ab-a363-cc3371b6b4de'} Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:33.862397 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.864159 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.865748 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:33.865849 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for user 20cf8769967d4169be2a2a82431c7df6 and project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:32:33.865951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0da7d424-d722-436a-b8e6-5c87907c692f tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 404 len: 111 microversion: 2.1 time: 0.032120 Aug 30 16:32:33.865951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 545/1084] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:33 2022] DELETE /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:32:33.869344 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:33.869958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] [instance: 986d0c22-4e47-46ab-a363-cc3371b6b4de] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:33.877175 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.877670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.878115 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.878845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.879573 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.880599 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.897340 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] HTTP exception thrown: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Request method failure captured: Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de HTTP/1.1 Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjn5aRBo4_qMFtQG65QJ7xb2pY2X3B1wReNuIfKCIPSCfXqjfpXVU8IEFPI0A6brSusLCzDMT7h2I6XHxz2p9z8nDqJK2dsZZD1zCiUFVqrxajC1f0H79xfmP_UPJofFUpZ07F30ASFedmgmyqICbxHxqdlRHzOoMbcMVBD4O4uGGhQ Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:32:33.898877 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d08b7bad519b4188b8cef19735f023fe"}]}] Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: d08b7bad519b4188b8cef19735f023fe Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877055789 Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: ea15538623ef4bacb42c4e03e2db72c5 Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-1877055789-project Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.900558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': '986d0c22-4e47-46ab-a363-cc3371b6b4de'} Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:33.901540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. Aug 30 16:32:33.902824 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:32:33.904089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] Returning 404 to user: Instance 986d0c22-4e47-46ab-a363-cc3371b6b4de could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:33.904089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b20698b-b743-45bc-a28a-4a546df10fef tempest-AttachVolumeNegativeTest-1877055789 tempest-AttachVolumeNegativeTest-1877055789-project] 10.222.0.57 "GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de" status: 404 len: 111 microversion: 2.1 time: 0.034593 Aug 30 16:32:33.904089 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 546/1085] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:33 2022] GET /compute/v2.1/servers/986d0c22-4e47-46ab-a363-cc3371b6b4de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:32:33.926447 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:32:33.928737 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c1a6f9b-aebd-44ef-97bf-9c2a24e0a67c',volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:32:34.059920 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6880a98b-959b-4f15-9330-13db6b615859 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727975 Aug 30 16:32:34.061386 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 540/1086] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:32:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:32:34.073216 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c0d8c8d-729b-4ca2-a1c9-e3e9ac1bf6e6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:34.074106 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c0d8c8d-729b-4ca2-a1c9-e3e9ac1bf6e6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:34.156424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c0d8c8d-729b-4ca2-a1c9-e3e9ac1bf6e6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.165617 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c0d8c8d-729b-4ca2-a1c9-e3e9ac1bf6e6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1093 microversion: 2.1 time: 0.096447 Aug 30 16:32:34.177428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 547/1087] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:34 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:35.186462 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:35.187128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:35.196498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.197001 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.197606 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.198331 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.198962 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.199610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.288837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:35.300310 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2ecbf0ba-d7f9-41de-8d89-e13e848a17ad tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1209 microversion: 2.1 time: 0.118109 Aug 30 16:32:35.300913 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 541/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:35 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:36.322183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:36.322797 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:36.330766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.331311 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.331763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.332482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.333437 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.333871 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.554833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.570483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99e4bd9d-e92c-4e02-95cb-38771a32b8bd tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.251759 Aug 30 16:32:36.571195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 548/1089] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:36 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:36.700349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b765296-302e-46eb-bcb6-4e5626e9da0e", "tag": "068f5fae-20d4-42fc-a852-f4260441de55"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:36.711904 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.712684 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.713120 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.724939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] Creating event network-changed:068f5fae-20d4-42fc-a852-f4260441de55 for instance 6b765296-302e-46eb-bcb6-4e5626e9da0e on hv-cinder-85220 Aug 30 16:32:36.730707 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-26f1fdb5-0e26-4385-bf5c-c9ab4cce0865 req-f3eb6807-99e8-4fa8-bb77-fabb8c7c8c4b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034379 Aug 30 16:32:36.731460 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 542/1090] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:32:37.592836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:37.593529 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:37.601298 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.602116 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.602793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.603666 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.604201 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.604704 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.787495 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.795239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0c45937-18ae-4c6c-8db0-460af6ad4edb tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.207047 Aug 30 16:32:37.796143 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 549/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:37 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:38.818129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:38.819401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:38.825621 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.826105 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.826668 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.827442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.827977 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.828564 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.967387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:38.981231 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f7f7c6c9-ce46-49aa-9e76-95c1eec520df tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.166212 Aug 30 16:32:38.981866 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 543/1092] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:38 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:40.006528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:40.007345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:40.013667 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.014150 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.014586 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.015309 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.015766 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.016193 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.164000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:40.172357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e88355b5-3b41-4bde-9d80-743dbfced7f7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.171503 Aug 30 16:32:40.172963 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 550/1093] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:39 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:41.196166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:41.196891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:41.204423 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.205724 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.206411 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.207250 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.208594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.209384 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.354121 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.362010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d65356e7-bfa7-403f-9f61-b9def0861f26 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.171892 Aug 30 16:32:41.362585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 544/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:41 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:42.382184 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:42.382825 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:42.389227 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.389718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.390166 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.390872 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.391357 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.391795 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.527270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:42.535317 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82c2b13e-38a8-4efe-b6e1-4adf85fd28a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.157155 Aug 30 16:32:42.536458 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 551/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:42 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:43.557959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:43.558610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:43.565071 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.565586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.566026 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:43.566727 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.567189 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.567645 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:43.700627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:43.708648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-a3d894a3-5a01-4139-a9cf-a7c7b7522684 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.154535 Aug 30 16:32:43.709214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 545/1096] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:43 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:44.739829 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:44.740377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:44.742801 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:44.748575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:44.749069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:44.749515 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:44.750228 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:44.750692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:44.751125 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:44.884391 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:44.893324 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8fa4e04-1949-4cce-93c5-f164d30bba83 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.158062 Aug 30 16:32:44.893897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 552/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:44 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:45.913917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:45.914531 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:45.916663 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:45.917325 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=6 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:45.917989 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:45.924122 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.924610 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.925046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.925745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.926200 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.926623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.931257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:46.068902 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:46.076648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-65713d6f-1caa-456b-abf9-dbe14d1dfc1e tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.166602 Aug 30 16:32:46.077211 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:45 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:47.097659 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:47.098866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:47.101392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:47.106670 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.107164 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.107641 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.108348 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.108812 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.109248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.112640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:47.244723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:47.252481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1dee2897-086d-43c2-8ae7-7fc99d7e6254 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.158694 Aug 30 16:32:47.253053 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 553/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:47 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:48.273395 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:48.274014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:48.280450 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:48.280939 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:48.281378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:48.282085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:48.282539 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:48.282965 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:48.418213 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:48.425775 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b3d605df-59ff-4f1c-99e8-9f69ec106dd2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.156304 Aug 30 16:32:48.426341 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 547/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:48 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:49.446575 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:49.447192 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:49.458897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:49.459620 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:49.460007 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:49.460763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:49.461238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:49.461672 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:49.608901 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:49.619517 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24220d8a-d8b1-4727-8e65-2203cd5cafda tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.177464 Aug 30 16:32:49.620104 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 554/1101] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:49 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:50.639891 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:50.641010 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:50.649586 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.650079 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.650631 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:50.651371 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.651825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.652247 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:50.791729 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:50.799377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ac625f3d-8f82-4bfa-8acb-768a6b946ec5 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.163278 Aug 30 16:32:50.799952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 548/1102] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:50 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:51.444918 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b765296-302e-46eb-bcb6-4e5626e9da0e", "name": "network-vif-plugged", "status": "completed", "tag": "068f5fae-20d4-42fc-a852-f4260441de55"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:51.454864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:51.455390 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:51.455818 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:51.466885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] Creating event network-vif-plugged:068f5fae-20d4-42fc-a852-f4260441de55 for instance 6b765296-302e-46eb-bcb6-4e5626e9da0e on hv-cinder-85220 Aug 30 16:32:51.471789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b1678870-b498-427a-be6e-4d4799e49dc6 req-92d15bf9-7829-4f12-bc47-ee062b6b4734 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031137 Aug 30 16:32:51.472377 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 555/1103] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:51.820203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:51.820718 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:51.827119 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:51.827636 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:51.828117 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:51.828755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:51.829209 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:51.829713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:51.959686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:51.967444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f7884d18-0ae6-410a-a5f6-d908bc596121 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.151089 Aug 30 16:32:51.968078 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 549/1104] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:51 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:52.989434 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:52.990141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:52.996341 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:52.996838 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:52.997281 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:52.997978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:52.998438 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:52.998870 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:53.130787 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:53.138490 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8ea04c1-1746-4df6-8920-8654e5b93ab7 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.153740 Aug 30 16:32:53.139058 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 556/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:52 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:54.159027 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:54.159666 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:54.166468 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:54.166952 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:54.167413 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:54.168109 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:54.168557 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:54.168978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:54.303817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:54.311662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-51ceb82d-d196-4df7-ac95-932839b16bd8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1265 microversion: 2.1 time: 0.156420 Aug 30 16:32:54.312235 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 550/1106] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:54 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:55.332324 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:55.332942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:55.339445 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:55.339932 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:55.340374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:55.341088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:55.341528 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:55.341955 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:55.479823 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:55.487602 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e91cd90-a25f-44e8-90b7-8b647e1769bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1452 microversion: 2.1 time: 0.159192 Aug 30 16:32:55.488176 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 557/1107] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:55 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:55.508522 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:55.509170 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:55.515798 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:55.516285 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:55.516747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:55.517466 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:55.517940 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:55.518360 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:55.651662 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:55.659451 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7dc090f4-26f4-4603-8c41-18e6976968a0 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1452 microversion: 2.1 time: 0.154991 Aug 30 16:32:55.660019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 551/1108] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:55 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:57.539940 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b765296-302e-46eb-bcb6-4e5626e9da0e", "tag": "068f5fae-20d4-42fc-a852-f4260441de55"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:57.549549 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:57.550639 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:57.551082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:57.562320 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] Creating event network-changed:068f5fae-20d4-42fc-a852-f4260441de55 for instance 6b765296-302e-46eb-bcb6-4e5626e9da0e on hv-cinder-85220 Aug 30 16:32:57.567329 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7782cb88-6794-47eb-b9bb-88b916359bcd req-c7f1329e-b79b-4d75-91f0-43464f4d6d47 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Aug 30 16:32:57.567920 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 558/1109] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:54.550063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-482476390", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "networks": [{"uuid": "7502e798-bbe7-40c9-b674-95efaf985eb3"}]}} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:54.559175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=11 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:54.559875 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=35 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:54.606251 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.network.neutron [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] validate_networks() for [('7502e798-bbe7-40c9-b674-95efaf985eb3', None, None, None, None, None)] {{(pid=120589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:33:54.954355 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Flavor limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:33:54.954705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Image limits 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:33:54.955277 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Flavor pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:33:54.955818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Image pref 0:0:0 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:33:54.956283 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.virt.hardware [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:33:54.965857 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.966344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.966785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.967555 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.968015 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.968442 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.986130 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Getting quotas for project abfbc1917a984eca86d589d76c39faa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:54.990112 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.quota [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Getting quotas for user db5e739e53ea446481597fa1e718b434 and project abfbc1917a984eca86d589d76c39faa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:55.000878 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Going to run 1 instances... {{(pid=120589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:33:55.003141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:33:55.049949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1d4ba28c-347b-4cb2-aaf2-f0fa0628ee98 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503795 Aug 30 16:33:55.050595 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 552/1110] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:33:55.061790 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=11 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:55.062542 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=27 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:55.066961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7d3d6fe-1b02-44a4-ad2f-bc4bd1d665b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:55.067689 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7d3d6fe-1b02-44a4-ad2f-bc4bd1d665b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:55.122618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7d3d6fe-1b02-44a4-ad2f-bc4bd1d665b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:55.129866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7d3d6fe-1b02-44a4-ad2f-bc4bd1d665b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1213 microversion: 2.1 time: 0.071414 Aug 30 16:33:55.130471 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 559/1111] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:55 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:56.151199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-643613cd-177a-4a9a-b798-9a6945409992 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:56.151835 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-643613cd-177a-4a9a-b798-9a6945409992 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:56.204713 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-643613cd-177a-4a9a-b798-9a6945409992 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:56.215135 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-643613cd-177a-4a9a-b798-9a6945409992 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1213 microversion: 2.1 time: 0.069044 Aug 30 16:33:56.215758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 553/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:56 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:57.236552 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7039dff0-6722-433b-aa7a-19c8bfa9447a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:57.237238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7039dff0-6722-433b-aa7a-19c8bfa9447a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:57.297671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7039dff0-6722-433b-aa7a-19c8bfa9447a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:57.305722 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7039dff0-6722-433b-aa7a-19c8bfa9447a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1213 microversion: 2.1 time: 0.073351 Aug 30 16:33:57.306388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 560/1113] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:57 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:58.327123 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-20473826-d6e4-4c4f-91e9-c69d2bd8e375 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:58.328182 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-20473826-d6e4-4c4f-91e9-c69d2bd8e375 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:58.384569 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-20473826-d6e4-4c4f-91e9-c69d2bd8e375 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.392317 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-20473826-d6e4-4c4f-91e9-c69d2bd8e375 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1213 microversion: 2.1 time: 0.069097 Aug 30 16:33:58.392973 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 554/1114] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:58 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:59.414562 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.415165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:59.421830 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.422316 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.422752 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.423483 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.423946 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.424374 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.486267 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:59.494572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61c58c04-2664-41dc-af16-a2614800ee34 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1217 microversion: 2.1 time: 0.084855 Aug 30 16:33:59.495167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 561/1115] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:59 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:00.517353 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:00.517972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:00.527111 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.527633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.528076 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.528787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.529248 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.529679 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.597909 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:00.606567 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e799a1ba-77f8-4bcd-8664-1a1e6a16616d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1271 microversion: 2.1 time: 0.093277 Aug 30 16:34:00.607148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 555/1116] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:00 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:01.540715 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1cc495-cf70-456e-b058-826d57072409", "tag": "03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:01.550440 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.550930 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.551401 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.562803 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] Creating event network-changed:03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67 for instance 8e1cc495-cf70-456e-b058-826d57072409 on hv-cinder-85220 Aug 30 16:34:01.567957 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5363a556-02a7-424f-a780-8f95645907ec req-89d97ad0-e740-44c8-9bbd-0313e1745acf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167105 Aug 30 16:34:01.568559 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 562/1117] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:01.628166 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:01.628785 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:01.639257 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.639826 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.640274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.641007 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.641469 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.641899 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.849665 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:01.857901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-bb0ec454-3d94-4cfe-9a37-27ddb7ca9365 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.233598 Aug 30 16:34:01.858477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 556/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:01 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:02.880308 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:02.881011 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:02.888449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.888939 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.889383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:02.890085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.890554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.890982 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.020811 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:03.028426 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df6a8f50-f872-454e-b6fe-3556c8d20345 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.152674 Aug 30 16:34:03.028998 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 563/1119] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:02 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:04.048845 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:04.049459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:04.056154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.056654 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.057098 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.057817 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.058276 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.058708 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.193980 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:34:04.194214 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Tue Aug 30 16:34:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 (ip 10.222.0.57) !!! Aug 30 16:34:04.288796 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:04.296563 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4d1e9311-4807-4441-acf5-ad650e5e5d1c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.251550 Aug 30 16:34:04.297142 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 557/1120] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:04 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:05.316855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:05.317505 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:05.325002 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.325492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.325936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.326640 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.327102 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.327574 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.459366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:05.467673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c35a6125-a325-4fab-8594-5a4048e706ba tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.154733 Aug 30 16:34:05.468338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 564/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:05 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:06.491491 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:06.492130 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:06.494055 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:06.500778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.501263 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.501695 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.503925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.503925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.503925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.655730 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:06.665596 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-297e6f1f-d647-4280-a415-1d317be88949 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.177914 Aug 30 16:34:06.666169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 558/1122] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:06 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:07.686128 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:07.686751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:07.689167 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:07.694428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.695543 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.695988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.696682 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.697140 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.697570 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.825238 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:07.832887 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b8175c0-4aa5-4f58-b5d8-5e2321d53b5a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.150632 Aug 30 16:34:07.833470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 565/1123] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:07 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:08.853330 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:08.853987 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:08.856521 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=10 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:08.861950 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.862445 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.862884 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.863667 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.864129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.864558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.949501 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1cc495-cf70-456e-b058-826d57072409", "name": "network-vif-plugged", "status": "completed", "tag": "03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:08.960568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.961248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.961681 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.973912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] Creating event network-vif-plugged:03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67 for instance 8e1cc495-cf70-456e-b058-826d57072409 on hv-cinder-85220 Aug 30 16:34:08.979017 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-897bee34-90cd-4590-a60c-0307c757e61b req-f036af27-837e-4da7-ae52-0c8ba1b3f95f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Aug 30 16:34:08.979836 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 566/1124] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:34:09.005294 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:09.015955 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c8e3cf57-62e8-430d-828c-8120bb26c4ed tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.166202 Aug 30 16:34:09.016544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 559/1125] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:08 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:10.037720 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:10.038449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:10.044799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:10.045286 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:10.045731 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:10.046428 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:10.046893 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:10.047358 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:10.180090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:10.190345 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18c14984-3a2f-43de-88da-d6ee0114b19b tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1313 microversion: 2.1 time: 0.157544 Aug 30 16:34:10.190950 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 567/1126] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:10 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:11.216515 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.217148 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.223671 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.224162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.224603 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.225307 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.226382 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.226812 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.366266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:11.374841 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-40f70986-3aec-4bb2-b2ab-59ee128f367d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1496 microversion: 2.1 time: 0.162178 Aug 30 16:34:11.375455 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 560/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:11 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:11.802334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.802937 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.810043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.810539 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.810985 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.811729 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.812195 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.812626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.839185 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:11.912991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14637e89-d52d-4e48-94a1-01e1f102b4cf tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 204 len: 0 microversion: 2.1 time: 0.114761 Aug 30 16:34:11.913673 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 568/1128] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:11 2022] DELETE /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:11.922414 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.923019 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.929497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.929972 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.930401 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.931087 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.931558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.931975 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.062273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:12.070487 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-e0deecc6-478d-46c8-a7ec-fc409d6a15bd tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1502 microversion: 2.1 time: 0.152397 Aug 30 16:34:12.071171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 561/1129] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:11 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:13.092925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:13.093633 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:13.099833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.100334 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.100779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.101481 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.101942 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.102376 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.250141 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:13.258725 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b04026f5-e2b2-4e9d-9906-1f7269cb76cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1502 microversion: 2.1 time: 0.170067 Aug 30 16:34:13.259319 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 569/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:13 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:13.835726 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1cc495-cf70-456e-b058-826d57072409", "name": "network-vif-deleted", "tag": "03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:13.848206 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.848664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.849171 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.863349 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] Creating event network-vif-deleted:03ad8fc0-ae9e-498b-a26e-6c2bf83c4b67 for instance 8e1cc495-cf70-456e-b058-826d57072409 on hv-cinder-85220 Aug 30 16:34:13.869784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-74619003-9b01-4edc-ae18-33566a46eeab req-de9cafae-932a-49c4-a988-728b50fe0962 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Aug 30 16:34:13.870392 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 562/1131] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:14.279779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:14.280392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:14.286787 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.287309 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.287743 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.289260 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.289719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.290149 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.322120 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.322597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.323029 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.323866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lazy-loading 'fault' on Instance uuid 8e1cc495-cf70-456e-b058-826d57072409 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:14.367273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:14.374335 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd7d7430-4181-4e96-a642-6bd83f6b81b0 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 200 len: 1303 microversion: 2.1 time: 0.098489 Aug 30 16:34:14.374902 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 570/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:14 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:15.396648 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:15.397354 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 8e1cc495-cf70-456e-b058-826d57072409] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:15.403672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.404165 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.404637 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.405334 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.405793 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.406219 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.419949 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] HTTP exception thrown: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Request method failure captured: Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 HTTP/1.1 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjvwSgmBWI-goYeKZQfe6GzMQF1XvhBoBHmutyo1iOS2EBaIwi4OeHdvtgwFAT62TecomYDzvEE_wFMCp_1N5zHeVTNc6hGp-mAkcQ_pAaEn5bcwB8DefSGm3x4pjDXslakx_bGyVCJc5p_-xw6gsZxNMJSz3mygKFN0OYC_wwGQk1g Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: abfbc1917a984eca86d589d76c39faa8 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesActionsTest-969853435 Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:34:15.421566 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/abfbc1917a984eca86d589d76c39faa8"}]}] Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesActionsTest-969853435 Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: abfbc1917a984eca86d589d76c39faa8 Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesActionsTest-969853435 Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesActionsTest-969853435-project Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: db5e739e53ea446481597fa1e718b434 Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesActionsTest-969853435-project Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. Aug 30 16:34:15.423387 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '8e1cc495-cf70-456e-b058-826d57072409'} Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:15.424463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. Aug 30 16:34:15.426093 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:15.427576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Returning 404 to user: Instance 8e1cc495-cf70-456e-b058-826d57072409 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:15.427576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-2651c878-6e23-4187-806a-ce68443aad41 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409" status: 404 len: 111 microversion: 2.1 time: 0.030883 Aug 30 16:34:15.427576 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 563/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:15 2022] GET /compute/v2.1/servers/8e1cc495-cf70-456e-b058-826d57072409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:15.473879 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1046760309", "imageRef": "92633262-0697-4c99-91ff-da5f0e21b13e", "flavorRef": "452", "networks": [{"uuid": "7502e798-bbe7-40c9-b674-95efaf985eb3"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:15.528567 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] validate_networks() for [('7502e798-bbe7-40c9-b674-95efaf985eb3', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:34:15.951069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:15.951527 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:15.952000 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:15.952444 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:15.952855 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:15.962078 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.962554 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.962987 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.963737 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.964190 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.964612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.981696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Getting quotas for project abfbc1917a984eca86d589d76c39faa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:15.985765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Getting quotas for user db5e739e53ea446481597fa1e718b434 and project abfbc1917a984eca86d589d76c39faa8. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:15.996718 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:15.998991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92633262-0697-4c99-91ff-da5f0e21b13e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:16.047152 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75022d63-aeb2-4a4b-8cfa-a1c345f68d4a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577396 Aug 30 16:34:16.047853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 571/1134] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:34:16.058545 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7a2ebb5e-2d2d-4816-8660-8c63d9172a1d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:16.059287 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7a2ebb5e-2d2d-4816-8660-8c63d9172a1d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:16.114237 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7a2ebb5e-2d2d-4816-8660-8c63d9172a1d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:16.121101 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7a2ebb5e-2d2d-4816-8660-8c63d9172a1d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1214 microversion: 2.1 time: 0.066435 Aug 30 16:34:16.121837 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 564/1135] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:16 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:17.144109 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:17.144710 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:17.151814 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.152310 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.152757 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.153695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.154169 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.154601 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.228544 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:17.236658 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c67611fa-ffae-41ea-aff7-d14f202f4b37 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1274 microversion: 2.1 time: 0.097764 Aug 30 16:34:17.237503 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 572/1136] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:17 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:18.259405 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:18.260052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:18.267318 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:18.267818 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:18.268589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:18.269316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:18.269778 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:18.270208 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:18.459974 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:18.467633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-b88351fe-2fde-46b8-822b-7f3c1b7291a3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.213269 Aug 30 16:34:18.468203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 565/1137] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:18 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:18.504280 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d14d4a4-55f7-4e3e-a689-0f89eb5db26f", "tag": "e77ac3b9-4c04-4a25-9d68-fb72e3294963"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:18.515160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:18.515694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:18.516135 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:18.528895 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] Creating event network-changed:e77ac3b9-4c04-4a25-9d68-fb72e3294963 for instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f on hv-cinder-85220 Aug 30 16:34:18.533751 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b94d186c-1d15-4d42-8cdb-c5a33ba193c4 req-5c680ff1-1e4d-4122-a240-6462a5dadd20 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033197 Aug 30 16:34:18.534371 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 573/1138] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:19.489404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:19.490030 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:19.497063 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:19.497544 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:19.497978 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:19.498669 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:19.499128 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:19.499584 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:19.628537 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:19.637497 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ee329909-1406-476f-91a2-0f28238c4223 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.151919 Aug 30 16:34:19.638108 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 566/1139] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:19 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:20.658961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:20.659721 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:20.665934 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:20.666421 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:20.666866 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:20.667592 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:20.668054 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:20.668487 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:20.804737 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:20.812625 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c2954b0-fe3d-4ef9-9225-2ca92f3bed53 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.158362 Aug 30 16:34:20.813208 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 574/1140] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:20 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:21.832916 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:21.833733 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:21.840149 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:21.840633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:21.841069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:21.841762 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:21.842217 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:21.842672 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:21.973496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:21.981143 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1e2b6fd7-e040-45ee-920e-b36e530e05c9 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.152121 Aug 30 16:34:21.981712 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 567/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:21 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:23.003739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:23.004951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:23.015083 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:23.015847 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:23.016492 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:23.017572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:23.018277 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:23.018928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:23.157297 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:23.165270 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a577d67f-4b07-41bb-9545-4fae36afe651 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.167155 Aug 30 16:34:23.165786 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 575/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:22 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:24.185850 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:24.186499 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:24.192959 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:24.193446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:24.193888 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:24.194585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:24.195046 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:24.195498 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:24.322797 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:24.330480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0ab3c6b7-81bd-4283-9811-090ae46f9bae tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.148677 Aug 30 16:34:24.331049 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 568/1143] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:24 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:25.111097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d14d4a4-55f7-4e3e-a689-0f89eb5db26f", "name": "network-vif-plugged", "status": "completed", "tag": "e77ac3b9-4c04-4a25-9d68-fb72e3294963"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:25.116931 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:25.122572 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.123637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.123637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.126296 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:25.136763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] Creating event network-vif-plugged:e77ac3b9-4c04-4a25-9d68-fb72e3294963 for instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f on hv-cinder-85220 Aug 30 16:34:25.142018 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e0067243-5c0b-44a9-a357-1f8e872b4596 req-c1bb4ded-e38a-4472-9d88-724c266ac392 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093311 Aug 30 16:34:25.142612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 576/1144] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:25.351808 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:25.352424 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:25.354901 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:25.360691 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.361175 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.361618 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.362315 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.362770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.363203 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.370747 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=73 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:25.502816 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:25.510839 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-8935b687-f816-445c-b0bc-d9ba5f999e9c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.163558 Aug 30 16:34:25.511446 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 569/1145] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:25 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:26.529770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:26.530598 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:26.536417 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:26.537128 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:26.546449 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:26.546874 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:26.547343 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:26.548136 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:26.548779 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:26.549241 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:26.687172 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:26.695916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-794a2409-a35f-46a6-8197-a5a79445504e tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1314 microversion: 2.1 time: 0.166965 Aug 30 16:34:26.696520 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 577/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:26 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:27.718494 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.719480 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:27.722083 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:27.730490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.731233 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.731917 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.732979 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.733681 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.734332 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.863956 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.872159 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-6b95f644-872c-4904-8f34-b592709c381a tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1497 microversion: 2.1 time: 0.160039 Aug 30 16:34:27.872740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 570/1147] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:27 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:28.304363 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.304948 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.311936 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.312424 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.312867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.313568 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.314032 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.314463 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.339853 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:28.426244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b7ef91c-1cd6-4bd0-8a9e-e41918b96155 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 204 len: 0 microversion: 2.1 time: 0.126515 Aug 30 16:34:28.426793 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 578/1148] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:28 2022] DELETE /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:28.435558 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.436169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.442298 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.442790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.443274 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.443997 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.444458 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.444925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.577844 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.586238 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-0fb5a934-e3b0-4f7f-9df5-543ece7b046c tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1503 microversion: 2.1 time: 0.154938 Aug 30 16:34:28.586819 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 571/1149] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:28 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:29.607978 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:29.608675 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:29.615082 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.615597 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.616677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.617366 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.617819 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.618243 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.758768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:29.767804 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db6e7209-bd07-4800-9d4d-caf55d9a22f3 tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1503 microversion: 2.1 time: 0.164200 Aug 30 16:34:29.769061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 579/1150] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:29 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:30.355774 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d14d4a4-55f7-4e3e-a689-0f89eb5db26f", "name": "network-vif-deleted", "tag": "e77ac3b9-4c04-4a25-9d68-fb72e3294963"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:30.367865 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.368352 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.368782 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.382660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] Creating event network-vif-deleted:e77ac3b9-4c04-4a25-9d68-fb72e3294963 for instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f on hv-cinder-85220 Aug 30 16:34:30.387622 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-345ba5dc-eb7c-4b73-9008-3b9dfaa30e73 req-bf0916c6-43d3-4c3c-b319-ca980bc508e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035588 Aug 30 16:34:30.388213 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 572/1151] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:30.789404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:30.789945 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:30.796183 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.796680 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.797119 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.797828 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.798285 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.798723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.832767 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.833253 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.833694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.834147 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lazy-loading 'fault' on Instance uuid 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:30.880840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5e739e53ea446481597fa1e718b434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbc1917a984eca86d589d76c39faa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.888765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4679c30e-93d3-4df3-894c-99d3bb3d446d tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 200 len: 1304 microversion: 2.1 time: 0.103354 Aug 30 16:34:30.889354 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 580/1152] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:30 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:31.911113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:31.911827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] [instance: 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.918090 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.918568 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.918995 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.919706 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.920153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.920575 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.933643 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] HTTP exception thrown: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Request method failure captured: Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f HTTP/1.1 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjvwSgmBWI-goYeKZQfe6GzMQF1XvhBoBHmutyo1iOS2EBaIwi4OeHdvtgwFAT62TecomYDzvEE_wFMCp_1N5zHeVTNc6hGp-mAkcQ_pAaEn5bcwB8DefSGm3x4pjDXslakx_bGyVCJc5p_-xw6gsZxNMJSz3mygKFN0OYC_wwGQk1g Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: abfbc1917a984eca86d589d76c39faa8 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-VolumesActionsTest-969853435 Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:34:31.935266 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/abfbc1917a984eca86d589d76c39faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/abfbc1917a984eca86d589d76c39faa8"}]}] Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-VolumesActionsTest-969853435 Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: abfbc1917a984eca86d589d76c39faa8 Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-VolumesActionsTest-969853435 Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-VolumesActionsTest-969853435-project Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: db5e739e53ea446481597fa1e718b434 Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-VolumesActionsTest-969853435-project Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. Aug 30 16:34:31.936976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '1d14d4a4-55f7-4e3e-a689-0f89eb5db26f'} Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:31.938039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. Aug 30 16:34:31.939779 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:34:31.941185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] Returning 404 to user: Instance 1d14d4a4-55f7-4e3e-a689-0f89eb5db26f could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:31.941185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f7f379c6-bd28-4495-b503-8c215ecd46cb tempest-VolumesActionsTest-969853435 tempest-VolumesActionsTest-969853435-project] 10.222.0.57 "GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f" status: 404 len: 111 microversion: 2.1 time: 0.030427 Aug 30 16:34:31.941185 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 573/1153] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:31 2022] GET /compute/v2.1/servers/1d14d4a4-55f7-4e3e-a689-0f89eb5db26f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:57.660885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-310589478", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2114089154", "security_groups": [{"name": "tempest-secgroup-smoke-1918406516"}], "block_device_mapping_v2": [{"uuid": "c7647dc5-aedc-46d7-b71d-0af56d359dd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc47b31-d639-4374-adee-5bb947993931"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:57.672383 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:57.673043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:57.778654 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] validate_networks() for [('1fc47b31-d639-4374-adee-5bb947993931', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:34:58.224651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:58.225079 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:58.225560 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:58.225976 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:58.226392 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:58.235462 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.235951 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.236425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.237165 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.237629 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.238059 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.256637 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:58.260671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.quota [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Getting quotas for user 20cf8769967d4169be2a2a82431c7df6 and project 63e7ee5c71674c23aca48909b417a52a. Resources: {'instances', 'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:58.322966 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:58.325117 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7647dc5-aedc-46d7-b71d-0af56d359dd0',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:58.481558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a44c45c2-6d98-477b-b3c4-7492a96dd9bf tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824434 Aug 30 16:34:58.482792 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 581/1154] 10.222.0.57 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:34:58.495404 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-f8f59114-a908-4c93-b47c-6df8f36fac90 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:58.496664 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-f8f59114-a908-4c93-b47c-6df8f36fac90 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:58.498851 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=9 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:58.499745 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=21 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:58.567834 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-f8f59114-a908-4c93-b47c-6df8f36fac90 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.576177 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-f8f59114-a908-4c93-b47c-6df8f36fac90 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1094 microversion: 2.1 time: 0.085984 Aug 30 16:34:58.576923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 574/1155] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:58 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:59.602252 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:59.603139 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:59.613719 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.614223 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.614671 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.615457 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.615928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.616364 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.702690 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.711912 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e575516-ae75-41eb-a891-df287146cc66 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1210 microversion: 2.1 time: 0.114982 Aug 30 16:34:59.712512 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 582/1156] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:59 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:00.733043 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:00.733578 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:00.740422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.740912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.741351 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.742056 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.742512 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.742935 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.956099 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:00.964453 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-4de57597-bd24-4405-bafe-e1e8af18c692 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.235453 Aug 30 16:35:00.965039 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 575/1157] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:00 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:01.233914 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42083a66-a0dc-4a3f-863c-09398938067c", "tag": "1cd079f3-a046-4ab5-8e75-a32ab0667630"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:01.246506 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.246927 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.247403 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.260309 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] Creating event network-changed:1cd079f3-a046-4ab5-8e75-a32ab0667630 for instance 42083a66-a0dc-4a3f-863c-09398938067c on hv-cinder-85220 Aug 30 16:35:01.265370 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8ad36f08-5f61-4e8b-842a-9f321a94f20d req-4aefaff8-b4dc-4559-8d8f-9df66f251b42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035343 Aug 30 16:35:01.265988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 583/1158] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:01.985686 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:01.986308 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:01.993417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.994051 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.994501 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.995249 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.995719 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.996151 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.128647 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:02.136655 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-46d4b1b9-a297-4718-b1a2-d4fc9d862fff tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.154815 Aug 30 16:35:02.137232 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 576/1159] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:01 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:03.158063 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:03.158806 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:03.165538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.166027 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.166468 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.167166 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.167657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.168088 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.320694 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:03.328425 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b13f7792-b536-4e70-a749-e409ad7cd89d tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.174583 Aug 30 16:35:03.328990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 584/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:03 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:04.348095 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:04.348627 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:04.355062 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.355590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.356020 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.356711 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.357167 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.357589 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.486682 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.494867 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-175d7dcf-6fbb-47b7-b35d-7bc3c1325892 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.150710 Aug 30 16:35:04.495478 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 577/1161] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:04 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:05.516313 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:05.516935 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:05.523995 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.524482 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.524928 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.525624 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.526085 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.526516 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.659248 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.666929 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b861f80-708b-496f-ab07-5972ee796ac6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.154505 Aug 30 16:35:05.667538 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 585/1162] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:05 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:06.687608 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:06.688223 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:06.695176 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.695827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.696265 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.697050 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.697596 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.698091 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.833594 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:06.844831 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-ca021361-6734-4ad0-ac6e-1b25513a2b3b tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.160869 Aug 30 16:35:06.845740 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 578/1163] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:06 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:07.875381 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:07.876008 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:07.882952 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.883469 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.883916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:07.884626 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.885094 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.885523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.020517 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.028273 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64638a7f-1b20-42e5-94c3-97f46918e0ba tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.156939 Aug 30 16:35:08.028845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 586/1164] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:07 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:09.049463 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:09.050070 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:09.052393 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell0:SELECT=2 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:09.058356 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.059072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.059696 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.060391 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.060935 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.061574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.196755 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.204426 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-cea12d52-202b-4944-a4b4-d543dc0ec053 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.158966 Aug 30 16:35:09.205022 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 579/1165] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:09 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:10.225486 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:10.226043 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:10.228001 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:10.228832 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:10.235100 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.235618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.236061 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.236770 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.237234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.237663 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.377523 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:10.386234 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d779382d-84eb-4252-98ea-9baf1cadc00c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.164720 Aug 30 16:35:10.386816 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 587/1166] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:10 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:11.407202 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:11.407821 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:11.415025 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:11.415560 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:11.415990 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:11.416677 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:11.417129 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:11.417550 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:11.554827 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:11.562780 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-39fc348d-b258-4425-a8b6-5c740437b061 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.159471 Aug 30 16:35:11.563486 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 580/1167] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:11 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:12.584558 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:12.585174 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:12.591361 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:12.591851 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:12.592294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:12.592990 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:12.593453 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:12.593885 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:12.725651 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:12.733284 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9cdc723-c40c-49ef-9199-a5b94d8d3916 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.153115 Aug 30 16:35:12.733840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 588/1168] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:12 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:13.242169 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42083a66-a0dc-4a3f-863c-09398938067c", "name": "network-vif-plugged", "status": "completed", "tag": "1cd079f3-a046-4ab5-8e75-a32ab0667630"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:13.253042 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.253378 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.253932 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.266154 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] Creating event network-vif-plugged:1cd079f3-a046-4ab5-8e75-a32ab0667630 for instance 42083a66-a0dc-4a3f-863c-09398938067c on hv-cinder-85220 Aug 30 16:35:13.271131 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-f8ef94e7-66dc-4f8b-899c-c32e9fc6ec51 req-6d569f91-e20e-4141-8b97-457ea1d3ba80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Aug 30 16:35:13.272394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 581/1169] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:13.754157 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:13.754958 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:13.761408 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.761897 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.762338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.763042 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.763526 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.763961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.893716 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:13.901926 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14bd8dd6-46ec-4b44-a90a-8e058508c679 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.151723 Aug 30 16:35:13.902540 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 589/1170] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:13 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:14.923045 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:14.923772 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:14.930490 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.930976 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.931479 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.932173 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.932635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.933082 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:15.069199 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:15.080072 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-d823ad6d-04f6-4c95-a219-25710453b856 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1266 microversion: 2.1 time: 0.161722 Aug 30 16:35:15.080764 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 582/1171] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:14 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:16.101030 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:16.101657 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:16.108197 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.108688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.109134 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.109840 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.110299 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.110738 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.245774 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:16.253530 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2eff12bc-92da-4358-9c0b-2b0a3e833fb8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1454 microversion: 2.1 time: 0.156493 Aug 30 16:35:16.254090 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 590/1172] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:16 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:16.274628 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:16.275268 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:16.281698 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.282183 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.282623 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.283345 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.283825 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.284245 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.413704 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:16.421585 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-389d171b-a907-4f5f-a8ad-15e8b316f109 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1454 microversion: 2.1 time: 0.151428 Aug 30 16:35:16.422162 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 583/1173] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:16 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:18.200845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42083a66-a0dc-4a3f-863c-09398938067c", "tag": "1cd079f3-a046-4ab5-8e75-a32ab0667630"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:18.211056 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:18.211571 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:18.212003 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:18.226677 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] Creating event network-changed:1cd079f3-a046-4ab5-8e75-a32ab0667630 for instance 42083a66-a0dc-4a3f-863c-09398938067c on hv-cinder-85220 Aug 30 16:35:18.231867 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b327e59d-1d72-412b-bfc5-b2b3ca48da4c req-962a5ce7-1349-40a7-99ca-f37eacb0c839 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034589 Aug 30 16:35:18.232407 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 591/1174] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:08.462361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_api:SELECT=22 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:08.463289 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG dbcounter [-] [120589] Writing DB stats nova_cell1:SELECT=50 {{(pid=120589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:08.464907 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 16:37:08.465114 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Tue Aug 30 16:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c (ip 10.222.0.57) !!! Aug 30 16:37:08.466417 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:37:08.466768 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Tue Aug 30 16:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c (ip 10.222.0.57) !!! Aug 30 16:37:08.469477 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:08.471278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=54 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:08.473161 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:08.473673 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:08.485784 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.486552 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.486991 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.487758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.488394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.488864 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.517705 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Going to try to terminate instance {{(pid=120589) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:37:08.608085 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-47826af2-2770-4555-8522-87858e7a72a2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "DELETE /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 204 len: 0 microversion: 2.1 time: 0.147382 Aug 30 16:37:08.612118 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 584/1175] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:37:08 2022] DELETE /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:37:08.620912 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:08.622444 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:08.629344 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.630092 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.630687 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.631435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.632047 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.632574 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.729160 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42083a66-a0dc-4a3f-863c-09398938067c", "tag": "1cd079f3-a046-4ab5-8e75-a32ab0667630"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:08.739470 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.739959 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.740410 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.751696 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] Creating event network-changed:1cd079f3-a046-4ab5-8e75-a32ab0667630 for instance 42083a66-a0dc-4a3f-863c-09398938067c on hv-cinder-85220 Aug 30 16:37:08.757097 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-661cfb95-5202-409a-951d-7937c0804521 req-e9995830-d544-45af-8b04-c50830c85c2c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294304 Aug 30 16:37:08.757864 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 592/1176] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:37:08.785400 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:08.794422 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c97a4651-171a-4ec9-8030-4a5e94985488 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1578 microversion: 2.1 time: 0.178624 Aug 30 16:37:08.794999 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 585/1177] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:08 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:09.817069 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:09.817763 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:09.825612 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:09.826205 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:09.826776 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:09.827768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:09.828275 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:09.828817 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:09.968904 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:09.976695 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00bef828-bcdf-4fc7-924f-28efb77a2ce8 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1578 microversion: 2.1 time: 0.164475 Aug 30 16:37:09.977265 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 593/1178] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:09 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:10.907459 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42083a66-a0dc-4a3f-863c-09398938067c", "name": "network-vif-deleted", "tag": "1cd079f3-a046-4ab5-8e75-a32ab0667630"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:10.920692 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:10.921168 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:10.921590 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:10.933155 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] Creating event network-vif-deleted:1cd079f3-a046-4ab5-8e75-a32ab0667630 for instance 42083a66-a0dc-4a3f-863c-09398938067c on hv-cinder-85220 Aug 30 16:37:10.939141 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-74205c5e-b8b0-4183-9410-d757c78e3362 req-054b897b-1bc0-4b57-a174-b0f5d264c450 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036166 Aug 30 16:37:10.939789 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 586/1179] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:10.997917 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:10.998541 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:11.005206 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.005693 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.006132 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.006845 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.007336 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.007768 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.073239 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:11.081531 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e14c251-d37b-4246-882f-73f999a7ec86 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 200 len: 1225 microversion: 2.1 time: 0.087628 Aug 30 16:37:11.082095 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 594/1180] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:10 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:12.105052 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:12.106394 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 42083a66-a0dc-4a3f-863c-09398938067c] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:12.115381 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:12.115876 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:12.116319 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:12.117031 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:12.117493 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:12.117923 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:12.132273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] HTTP exception thrown: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Request method failure captured: Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c HTTP/1.1 Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjrjcPIajaM9CnH4cNitYbPis4JBhxv4k0iwTMGjysvs3g2LEaLVdwNFYMGFtUys7mn6sBV4TS_PJTNn4dF9pvAahvbS9kv1fZF7IAgXItNm4R5PhyHBiIlhmXExBeFdGeURnGB6l6cLdK878BTrWEwJsjXO3LZJOEkCNO1SuCThqSo Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:37:12.133929 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}] Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 20cf8769967d4169be2a2a82431c7df6 Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. Aug 30 16:37:12.135754 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '42083a66-a0dc-4a3f-863c-09398938067c'} Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:37:12.137477 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. Aug 30 16:37:12.139361 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:12.140770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Returning 404 to user: Instance 42083a66-a0dc-4a3f-863c-09398938067c could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:37:12.140770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-13c2a193-f960-48f4-8310-6f7d8093b4b6 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c" status: 404 len: 111 microversion: 2.1 time: 0.035125 Aug 30 16:37:12.140770 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 587/1181] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:12 2022] GET /compute/v2.1/servers/42083a66-a0dc-4a3f-863c-09398938067c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:37:15.457294 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:15.457961 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:15.459688 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b765296-302e-46eb-bcb6-4e5626e9da0e", "tag": "068f5fae-20d4-42fc-a852-f4260441de55"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:15.464266 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.464765 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.465211 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.465925 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.466388 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.467416 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.471767 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.472320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.472994 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.487316 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] Creating event network-changed:068f5fae-20d4-42fc-a852-f4260441de55 for instance 6b765296-302e-46eb-bcb6-4e5626e9da0e on hv-cinder-85220 Aug 30 16:37:15.493267 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-dd17c668-baef-4459-b106-1c483e5a9247 req-d9e5ba5f-20a5-4a2b-8049-ae963f849199 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037677 Aug 30 16:37:15.494435 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 588/1182] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:15.507723 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:37:15.595788 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-932259a9-f0fb-495c-87f1-5402a26ff2a9 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 204 len: 0 microversion: 2.1 time: 0.142202 Aug 30 16:37:15.599404 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 595/1183] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:37:15 2022] DELETE /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:37:15.605255 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:15.605963 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:15.612619 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.613016 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.613461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.614178 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.614635 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.615069 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.767269 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.policy [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120589) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:15.775014 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-7403c6bb-223d-456e-94ea-4b937c6dd164 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1576 microversion: 2.1 time: 0.174036 Aug 30 16:37:15.775824 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 589/1184] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:15 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:16.796546 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:16.797245 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:16.803821 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:16.804304 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:16.804740 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:16.805438 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:16.805891 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:16.806315 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:17.023288 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:17.031645 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b515b794-5007-41ba-b500-233323c43988 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1576 microversion: 2.1 time: 0.239984 Aug 30 16:37:17.032225 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 596/1185] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:16 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:17.647787 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b765296-302e-46eb-bcb6-4e5626e9da0e", "name": "network-vif-deleted", "tag": "068f5fae-20d4-42fc-a852-f4260441de55"}]} {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:17.657928 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:17.658429 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:17.658836 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:17.671038 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.compute.server_external_events [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] Creating event network-vif-deleted:068f5fae-20d4-42fc-a852-f4260441de55 for instance 6b765296-302e-46eb-bcb6-4e5626e9da0e on hv-cinder-85220 Aug 30 16:37:17.676377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [req-5713700a-52c2-4b48-bb0d-8f06bb359e7b req-53cb9b17-ecd7-44ab-b642-d8709bc7a87c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Aug 30 16:37:17.676986 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 590/1186] 10.222.0.57 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:18.052993 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:18.053692 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:18.060347 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.060843 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.061325 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.062052 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.062519 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.062956 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.095688 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.096177 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.096618 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.097073 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lazy-loading 'fault' on Instance uuid 6b765296-302e-46eb-bcb6-4e5626e9da0e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:37:18.138739 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.policy [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cf8769967d4169be2a2a82431c7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e7ee5c71674c23aca48909b417a52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:18.146411 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59a5b894-36b9-457f-bc4e-1f8ce5ecb9c2 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 200 len: 1229 microversion: 2.1 time: 0.097732 Aug 30 16:37:18.146988 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 597/1187] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:18 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:19.168918 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:19.170113 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: 6b765296-302e-46eb-bcb6-4e5626e9da0e] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:19.176303 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.176790 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.177228 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.177925 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.178377 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.178806 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.192800 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] HTTP exception thrown: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Request method failure captured: Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e HTTP/1.1 Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjrjcPIajaM9CnH4cNitYbPis4JBhxv4k0iwTMGjysvs3g2LEaLVdwNFYMGFtUys7mn6sBV4TS_PJTNn4dF9pvAahvbS9kv1fZF7IAgXItNm4R5PhyHBiIlhmXExBeFdGeURnGB6l6cLdK878BTrWEwJsjXO3LZJOEkCNO1SuCThqSo Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:37:19.194457 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}] Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 20cf8769967d4169be2a2a82431c7df6 Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. Aug 30 16:37:19.196240 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': '6b765296-302e-46eb-bcb6-4e5626e9da0e'} Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:37:19.197153 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. Aug 30 16:37:19.198771 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.200320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Returning 404 to user: Instance 6b765296-302e-46eb-bcb6-4e5626e9da0e could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:37:19.200320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-1cb2a00b-717f-4578-b2c5-9187a69ea785 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e" status: 404 len: 111 microversion: 2.1 time: 0.031877 Aug 30 16:37:19.200320 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 591/1188] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:19 2022] GET /compute/v2.1/servers/6b765296-302e-46eb-bcb6-4e5626e9da0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:37:19.653819 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:19.654799 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:19.661338 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.661833 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.662274 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.662981 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.663475 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.663916 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.677735 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] HTTP exception thrown: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Request method failure captured: Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 HTTP/1.1 Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept: application/json Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Accept-Encoding: identity Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Connection: close Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Length: 0 Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Content-Type: application/json Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Host: 10.222.0.57 Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: Openstack-System-Scope: None Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjDjrjcPIajaM9CnH4cNitYbPis4JBhxv4k0iwTMGjysvs3g2LEaLVdwNFYMGFtUys7mn6sBV4TS_PJTNn4dF9pvAahvbS9kv1fZF7IAgXItNm4R5PhyHBiIlhmXExBeFdGeURnGB6l6cLdK878BTrWEwJsjXO3LZJOEkCNO1SuCThqSo Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Id: None Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Domain-Name: None Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Identity-Status: Confirmed Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Is-Admin-Project: True Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Id: default Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Domain-Name: Default Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Role: member,reader Aug 30 16:37:19.679451 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Roles: member,reader Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}] Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Id: default Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Domain-Name: Default Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Id: 20cf8769967d4169be2a2a82431c7df6 Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: method: > Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: exception: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.681163 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: action_args: {'id': 'da074dd8-200d-4a07-b279-eb1fd9082281'} Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:37:19.682180 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.683854 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.685789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Returning 404 to user: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:37:19.685789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1bdc7fb-aa4b-4b05-a3a1-aeacf8b32ca3 tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "DELETE /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 404 len: 111 microversion: 2.1 time: 0.031399 Aug 30 16:37:19.685789 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 598/1189] 10.222.0.57 () {58 vars in 1239 bytes} [Tue Aug 30 16:37:19 2022] DELETE /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:37:19.689496 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '>' {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:19.690102 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.compute.api [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] [instance: da074dd8-200d-4a07-b279-eb1fd9082281] Fetching instance by UUID {{(pid=120589) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:19.696157 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.696633 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.697061 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.697741 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Acquiring lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.698191 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.698606 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG oslo_concurrency.lockutils [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Lock "e08a4461-15f4-4c54-a4a6-891b450b71c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.711758 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.wsgi [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] HTTP exception thrown: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Request method failure captured: Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: request: GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 HTTP/1.1 Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept: application/json Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Accept-Encoding: identity Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Connection: close Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Length: 0 Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Content-Type: application/json Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Host: 10.222.0.57 Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: Openstack-System-Scope: None Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: User-Agent: python-urllib3/1.26.12 Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Auth-Token: gAAAAABjDjrjcPIajaM9CnH4cNitYbPis4JBhxv4k0iwTMGjysvs3g2LEaLVdwNFYMGFtUys7mn6sBV4TS_PJTNn4dF9pvAahvbS9kv1fZF7IAgXItNm4R5PhyHBiIlhmXExBeFdGeURnGB6l6cLdK878BTrWEwJsjXO3LZJOEkCNO1SuCThqSo Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Id: None Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Domain-Name: None Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Identity-Status: Confirmed Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Is-Admin-Project: True Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Id: default Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Domain-Name: Default Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Project-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Role: member,reader Aug 30 16:37:19.713273 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Roles: member,reader Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/63e7ee5c71674c23aca48909b417a52a"}]}] Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Id: 63e7ee5c71674c23aca48909b417a52a Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280022739 Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Id: default Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Domain-Name: Default Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Id: 20cf8769967d4169be2a2a82431c7df6 Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: X-User-Name: tempest-TestVolumeBootPattern-1280022739-project Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: method: > Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: exception: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.715914 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: action_args: {'id': 'da074dd8-200d-4a07-b279-eb1fd9082281'} Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: {{(pid=120589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:37:19.717660 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. Aug 30 16:37:19.719461 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: ERROR nova.api.openstack.wsgi Aug 30 16:37:19.720992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: DEBUG nova.api.openstack.wsgi [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Returning 404 to user: Instance da074dd8-200d-4a07-b279-eb1fd9082281 could not be found. {{(pid=120589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:37:19.720992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: INFO nova.api.openstack.requestlog [None req-c1ff4dcf-595c-4ff1-8dea-4f7e1ae75a4c tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281" status: 404 len: 111 microversion: 2.1 time: 0.029241 Aug 30 16:37:19.720992 dv-cinder-852208-13-iscsi devstack@n-api.service[120589]: [pid: 120589|app: 0|req: 592/1190] 10.222.0.57 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:19 2022] GET /compute/v2.1/servers/da074dd8-200d-4a07-b279-eb1fd9082281 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:37:21.022244 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ee60dbe-4b23-44be-b257-af6176a32b7f tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] Calling method '.version_select at 0x7f1266dcc790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:21.044991 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ee60dbe-4b23-44be-b257-af6176a32b7f tempest-TestVolumeBootPattern-1280022739 tempest-TestVolumeBootPattern-1280022739-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2114089154" status: 202 len: 0 microversion: 2.1 time: 0.026481 Aug 30 16:37:21.046278 dv-cinder-852208-13-iscsi devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 599/1191] 10.222.0.57 () {58 vars in 1263 bytes} [Tue Aug 30 16:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2114089154 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)